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The  Idea  which  prompted  the  present  research  was  that  biological  events  may  be 
predictive  of  the  attentlonal  and  task  demands  of  work.  If  these  could  be  analyzed  In 
,  real  tine  and  fed  btek  to  the  machine  (or  operator),  a  truly  biocybernetic  system 

*  could  be  created.  ^  non Intrusive  reliable  measure  of  individual  differences  such  as 
attention  during  mbnltorlng  and  control  tasks  has  obvious  biocybernetic  relevance, 
particularly  In  dynamic  environments  and  for  design  of  equipment.  '  In  Phase  I,'£wo 

*  investigations  smt#  performed  to  assess  the  feasibility  of  using  specific  character¬ 
istics  of  eye  mwemant  saccades  as  unobtrusive  Indicants  of  mental  workload.  Bye 
movements  were /measured  while  subjects  were  differentially  task  loaded  by  simple, 
moderate,  and/complex  auditory  tone  count inq.  The  results  indicated  that  the  extent 
of  saccadic  /ye  movements  varied  Inversely  In  subjects  as  tone  counting  complexity 
Increased,  /phase  II  experimentation  Involved  a  series  of  Interlocking  experiments  and 
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19.  Abstract  (cont'd) 


proof  of  concept  demonstrations.  In  the  studies  performed  In  this  series,  reliable 
data  were  obtained  with  as  few  as  three  subjects,  provided  there  were  sufficient 
calibrations  and  stable  baselines  of  performance  measures.  We  found  that  saccade 
length  Index  of  taskload  was  related  to  the  workload  under  which  the  operator  performs 
•  and  not  with  performance  per  se.  that  is.  the  predictive  validity  of  SLIT  Is  chiefly 
as  an  Index  of  the  objective  Information  load  to  the  operator,  even  when  visual  tasks 
are  employed,  this  finding  surfaced  when  the  effects  of  practice  were  examined. 

'  Practice  did  not  have  as  much  effect  on  SLIT  as  did  the  objective  index  of  task 
loading.  Therefore,  tdtlle  performance  Improved  when  tasks  of  different  difficulty 
were  practiced  for  many  sessions,  it  appeared  that  the  chief  determinant  of  saccade 
length  was  the  number  of  channels  which  were  monitored.  The  SLIT  effect,  which  was 
■originally  demonstrated  In  the  dark  with  an  auditory  task,  was  obtained  in  a  lighted 
room  while  monitoring  a  visual  signal,  thus  broadening  potentially  the  applicability 
of  the  phenomenon,  hlso.  In  a  simulated  field  test.  SLIT  was  demonstrated  to  be 
robust  even  «4ien  a  visual  forcing  function  (optokinetic  nystagmus)  was  present. 

A  literature  review  and  meta-analysls  was  conducted  to  synthesize  the  literature 
on  workload  measures  and  was  presented  in  a  series  of  tables.  In  general,  the  number 
of  performance-based  measures  appeared  to  be  on  the  upsurge  over  the  past  decade  and 
physiological  measures  not  Involving  eye  movements  appeared  to  be  on  the  downswing. 

The  number  of  subjective  measures  of  workload  studies  were  stable.  Investigations  of 
ocular-based  measures,  particularly  cortical -evoked  potentials,  were  on  the  Increase. 
The  chief  finding  from  a  fully  quantltltatlve  meta-analysis  of  the  ocular-based 
measures  found  a  sufficient  predicate  for  continuing  the  directions  of  the  saccade 
Length  Index  of  Taskload  (Workload)  (SLIT)  research  since  predictive  validities  of  eye 
movement  research  in  general  appeared  to  be  robust  (particularly  eyebllnk),  and 
several  types  of  studies  which  examined  eye  movement  extent  (like  SLIT)  were 
considered  to  hold  promise.  In  the  feasibility  demonstrations,  vertical  and 
horizontal  eye  movements  became  resolved  and  left-  and  right-eye  recordings  were  also 
separated.  The  former  was  a  necessary  condition  for  isolating  blinks,  and  the  latter 
was  a  first  step  in  removing  artifacts  from  the  eye  movement  records  which  might  be 
due  to  other  oculomotor  activities  (e.g.,  vergence,  convergence,  and  accommodation) . 

Software  development  occurred  when  the  work,  originally  conducted  in  the  more 
controlled  environment  of  a  university  laboratory  using  stationary  equipment  (e.g.. 
Infrared,  head-fixed,  oculometer)  and  hand  scoring,  was  transferred  to  a  regular 
office.  There  the  software  and  hardware  development  continued  and  a  series  of  proof 
of  concept  and  feasibility  demonstrations  were  undertaken.  A  low-cost  microprocessor 
.*  was  selected  for  the  SLIT  system  and  software  was  developed  and  customized  to  produce 
a  quasi- port able  system.  The  customized  program  has  the  ability  to  reject  blinks  and 
it  is  possible  to  Integrate  eye  movement  records  and  deliver  analyses  automatically, 

.  scored  within  2.5  minutes.  The  software  program  possesses  many  scoring  and 
integration  features  (viz.,  left  vs.  right  eyas,  vertical  vs.  horizontal, 
vergence/convergence  differences,  velocity,  •  eye  movements),  which  will  easily  be 
accommodated  by  larger  capacity,  more  permanently  emplaced,  laboratory  systems. 
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19.  Abstract  (cont'd) 

The  possible  commercial  applications  of  SLIT  for  the  private  sector  are 
considerable.  SLIT  may  be  used  as  an  Independent  assessment  of  an  Individual's 
attention  which  may  wane  with  time  on  task  or  due  to  other  factors.  Such  a 
relationship  might  be  of  Interest  during  quality  control  on  assembly  lines,  or  In 
remote  emplacements  where  security  displays  are  monitored.  Since  SLIT  size  appears  to 
be  proportional  to  workload,  displays  and  workstations  could  be  tested  and  evaluated 
objectively  and  compared  for  difficulty  level.  Tn  addition,  preliminary  evidence 
suggests  that  individual  differences  In  saccade  length  My  be  sufficiently  reliable  so 
that  they  could  be  studied  for  stability  over  tlM  and  then  examined  for  relations  to 
equipment  and  operator  aptitude  tradeoffs  In  systems  designs. 
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EXECUTIVE  SUMMARY 


Invest 19a t Ions  of  workload  are  the  logical  extension  of  the  t ime  and 
notion  studies  of  Gilbert  and  Taylor,  which  are  often  used  to  date  the  formal 
beginnings  of  human  engineering  and  systems  research.  We  use  the  term 
workload  to  refer  to  the  demands  imposed  on  a  given  human  operator  by  a  given 
task.  Workload  measurement  involves  an  attempt  to  characterize  conditions 
under  which  task  demands  can  or  cannot  be  met  by  the  performer.  The  problems 
in  workload  measurement  are  many.  In  a  recent  Congressional  hearing,  for 
example,  human  factors  experts  offered  their  opinions  as  to  the  cause  of  the 
downing  of  Iran  Air  Flight  655.  Opinions  differed  depending  on  area  of 
expertise,  but  there  was  consensus  that  an  incorrect  decision  had  been  made 
from  displayed  information  and  the  incident  was  due  to  the  combined  effects  of 
high  workload  and  combat  stresses.  Perhaps  more  importantly,  these  factors 
were  not  addressed  in  the  design  of  the  AEGIS  tactical  information  displays. 
Better  workload  measurement  Is  needed  both  from  the  standpoint  of  the 
Independent  variable  (the  workstation)  and  the  dependent  variable  (how  It 
affects  the  operator).  If  such  Information  were  available  with  sufficient 
precision,  it  would  be  possible  to  take  the  output  of  the  individual's 
interactions  with  displayed  information  and  modify  the  display  so  the  system 
will  better  accommodate  the  Individual's  needs. 

The  present  research  presumes  that  biological  events  may  be  predictive  of 
the  attentlonal  and  task  demands  of  work.  If  these  could  be  analyzed  in  real 
time  and  fed  back  to  the  machine  (or  operator),  a  truly  blocybernet ic  system 
could  be  created.  For  example,  we  know  there  may  be  little  or  no 
deterioration  In  operational  performance  until  the  point  of  failure  is  closely 
approached,  but  perhaps  sensitive  biological  measures  of  workload  could 
provide  premonitory  signs  of  impending  failure. 

In  Phase  I,  two  investigations  assessed  the  feasibility  of  using  specific 
characteristics  of  eye  movement  saccades  as  unobtrusive  indicants  of  mental 
workload.  Eye  movements  were  measured  while  subjects  were  differentially  task 
loaded  by  simple,  moderate,  and  complex  auditory  tone  counting.  The  extent  of 
saccadic  eye  movements  varied  inversely  in  subjects  as  tone  counting 
complexity  increased. 

The  second  Phase  l  experiment  used  the  same  equipment  and  explored  further 
the  relationship  of  eye  movement  measures  (saccade  length)  to  workload.  We 
also  incorporated  experimental  evidence  of  high  arousal.  To  organize  our 
activities  we  employed  a  2X2  classification  schema  of  workload  measures  to 
improve  descriptive  precision  and  permit  improved  communication  of  ideas. 

To  test  the  relationship  between  saccade  length  and  arousal,  subjects  in 
the  second  Phase  I  experiment  performed  an  auditory  tone  counting  task  at 
thtee  levels  of  difficulty  while  saccadic  eye  movements  were  recorded. 
Performance  varied  inversely  with  difficulty  level  of  the  tone  counting  task 
suggesting  that  the  different  task  conditions  induced  different  levels  ot 
mental  workload.  Average  length  of  saccadic  eye  movements  was  also  reduced 
with  Increased  task  difficulty.  Correlation  coefficients  between  saccade 
length  and  performance  for  each  subject  ranged  from  r  *  .37  to  r  ■  .99  with  a 
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mean  of  r  *  .64.  Results  suggested  that  saccade  length  was  a  promising 
objective  measure  of  task  demands  of  a  display  and  could  serve  as  a  useful 
measure  of  mental  workload. 

Phase  II  objectives  were  to  develop  further  the  Saccade  Length  Index  of 
Taskload  (Workload)  or  SLIT  and  cross-valldate  the  results  of  Phase  I.  The 
ultimate  outcome  of  Phase  II  would  be  prototype  development  of  a  transportable 
system  to  assess  mental  workload  via  the  SLIT  metric  and  other  bioelectric 
measures  as  appropriate.  A  chief  Ingredient  in  initial  development  of  such  a 
system  was  a  focus  on  rapid  (i.e.,  seconds)  evaluation  of  the  bioelectric 
events  so  that,  when  properly  identified  and  classified,  such  signals  could  be 
fed  back  to  signal  generators.  This  work  is  divided  into  three  main  thrusts: 
Meta-analysis,  Experimentation,  and  Software  Development.  The  meta-analysis 
section  has  two  components  —  a  literature  review  as  well  as  a  quantitative 
meta-Ana lysis.  The  sections  on  experimentation  describe  a  series  of  studies 
which  address  various  aspects  of  implementing  and  measuring  SLIT.  The 
software  development  section  outlines  procedure  and  Implementation  of  the 
apparatus  and  scoring  used. 

A  meta-analysis  was  conducted  to  synthesize  the  literature  on  workload 
measures  and  is  presented  in  a  series  of  tables.  In  general,  the  number  of 
performance  based  measures  is  on  the  upsurge  over  the  past  decade,  and 
physiological  measures  not  involving  eye  movements  are  on  the  downswing.  The 
use  of  subjective  workload  measures  is  stable.  Investigations  of  ocular  based 
measures,  particularly  cortical  evoked  potentials,  were  on  the  increase.  The 
chief  finding  from  the  quant  it ltat ive  meta  analysis  of  the  ocular  based 
rteasuics  wa_  «  jutClcLewk  predicate  £oi  continuing  th«  directions  of  SI. IT 
research,  since  predictive  validities  of  eye  movement  research  in  general 
appeared  to  be  robust. 

Kxpei imentat ion  Involved  a  series  of  interlocking  experiments  and  proof  of 
concept  demons  t  rat  lofts'  si. it  measures  are  related  to  the  workload  under  which 
the  operator  performs,  and  not  to  performance  per  se .  That  is,  iite  predictive 
validity  of  SLIT  is  chiefly  as  an  index  of  the  objective  information  load  to 
the  operator,  even  when  visual  tasks  are  employed.  While  performance  improved 
when  tasks  of  different  difficulty  were  practiced  for  many  sessions,  the  chief 
determinant  of  saccade  length  was  the  number  of  channels  being  monitored.  The 
Sl.lT  effect,  which  was  originally  demonstrated  in  the  dark  with  an  auditory 
task,  was  obtained  in  a  lighted  room  while  monitoring  a  visual  signal,  thus 
broadening  potentially  the  applicability  of  the  phenomenon .  Also,  in  a 
simulated  field  test,  SLIT  was  demonstrated  to  he  robust  oven  when  a  visual 
forcing  function  (optokinetic  nystagmus)  was  present. 

Finally ,  software  development  “automated*  the  scoring  process  and 
converted  stationary  equipment  to  a  quasi  portable  system  on  a  low  cost 
microcomputer.  The  customized  scoring  program  has  the  ability  to  reject 
blinks  and  it  is  possible  to  Integrate  eye  movement  records  and  deliver 
analyses,  automatically  scored,  within  2.b  minutes.  The  software  program 
possesses  many  scoring  and  Integration  features  (viz.,  left  vs.  right  eyes, 
vertical  vs.  horizontal,  vergence/cofivergeuce  differences  can  oe  separated, 
velocity),  which  will  easily  be  accommodated  by  larger  capacity,  more 
permanently  emplaced,  laboratory  systems. 
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INTRODUCTION 


In  the  early  days  of  aviation,  the  machine  was  often  the  limiting  factor 
In  system  performance.  Today,  overstressed  aviators  may  be  more  common  than 
overstressed  aircraft.  In  addition  to  the  structural  Improvements  that  modern 
technology  has  provided,  new  systems  permit  more  Information  to  be  presented 
In  real-  or  fast-time  to  the  operator  than  he  or  she  can  handle  efficiently. 
Descriptive  terms  like  "getting  behind  the  system,"  Information  overload,"  and 
"noisy”  abound  In  design  conferences,  and,  poignantly,  we  have  "declutter 
switches."  In  modern  weapon  systems  the  human  sensory  systems  are  often 
bombarded  with  stimuli  with  the  consequence  that  analyses  of  displayed 
Information  are  time  constrained.  These  issues  are  not  limited  to  military 
Jobs.  Civilian  air  traffic  controllers  are  often  retired  for  Job-related 
workload  stress  (Hale,  Williams,  Smith,  &  Melton,  19/1),  and  astronauts 
experience  "time  compression*  in  connection  with  their  high  workload  periods 
upon  reentry  (Schmitt  &  Reid,  1985).  As  military  equipment  has  been  made  more 
complex,  the  proportion  of  the  available  pool  of  personnel  which  possesses  the 
mental  capabilities  to  accommodate  the  system  is  becoming  more  limited  (Tice, 
1986;  Merriman  &  Chatelier,  1981). 

Investigations  of  workload  are  the  logical  extension  of  the  time  and 
motion  studies  of  Gilbert  and  Taylor  which  are  often  used  as  the  formal 
beginnings  of  human  engineering  and  systems  research.  Therefore,  we  will  not 
describe  at  any  length  what  workload  is  and  why  we  study  it.  These  problems 
do  not  come  as  any  surprise  to  those  who  grew  up  in  the  field  of  human  factors 
engineering.  Indeed,  they  were  eloquently  predicted  by  Chapanis,  Garner, 
Morgan,  and  banford  (’947)  in  one  of  the  earliest  works  on  systems  research 
where  they  said,  "...Let  us  look  ahead  about  50  years  (it's  only  4211  and 
imagine  what  kind  of  problem  the  air  traffic  control  officer  at  LaGuard  r 
Held  will  have  when  a  heavy  fog  settles  over  the  place  and  100  planes 
converge  on  the  field  from  Mexico,  lr>ndon.  Paris,  ban  Francisco,  and 
Albuquerque.  How  are  we  going  to  get  all  that  information  to  him  [sic!].  How 
can  we  present  this  Information  to  him  so  that  he  can  see  the  total  picture? 
There  are,  after  all,  only  a  few  channels  that  w  can  use  in  getting  this 
Information  Into  his  brain"  (p.  240).  Kelatedly,  and  more  recently  in  a 
Congressional  hearlnq,  several  prominent  human  factors  experts  from  different 
fields,  inside  and  outside  the  Department  of  Defense,  were  invited  to  offer 
their  opinions  as  to  the  cause  of  the  downing  of  the  Iran  Air  Flight  655. 
Granted  that  an  Incorrect  decision  had  been  made  from  displayed  information  in 
that  case,  the  one  Issue  about  which  the  experts  appeared  concordant  was  that 
the  incident  was  due  to  the  combined  effects  of  the  high  workload  and  combat 
stresses  which  were  not  accommodated  in  the  human  factors  design  of  the 
tactical  information  displays  for  the  AEGIS  weapon  system  (House  Armed 
Services  Committee,  1988).  Wc  do  need  to  do  better  at  workload  measurement, 
both  from  the  standpoint  of  the  Independent  variable  (the  workstation)  and  the 
dependent  variable  (how  it  affects  the  cperatoi).  This  paper  will  argue  that. 
If  such  information  were  available  with  sufficient  precision,  it  would  be 
possible  to  take  the  output  of  the  Individual's  difficulty  with  displayed 
information  and  by  some  means  feed  this  information  back  Into  the  system  so 
that  the  system  will  better  accommodate  the  individual's  needs.  Following 
Weiner  (1948),  we  think  that  something  like  this  is  what  K.U.  Smith  (1966, 


196'/;  Smith  &  Smith,  1966)  had  in  mind  when  he  began  writing  about 
biocybernetics  some  25  years  ago. 

For  the  exposition  of  our  ideas,  we  have  used  the  term  workload  to  refer 
to  the  demands  imposed  on  a  given  human  operator  by  a  given  task,  and  workload 
measurement  involves  an  attempt  to  characterize  conditions  under  which  task 
demands  can  or  cannot  be  met  by  the  performer  (Gopher  6  Braune,  1984).  Later, 
we  describe  a  2X2  classif ication  schema  which  we  have  employed  to  organize  our 
present  effort.  We  believe  that  the  improved  descriptive  precision  of  this 
model  will  permit  Improved  coonun Ication  of  ideas.  The  classification  follows 
from  statistical  theory  and  its  assumptions,  and  we  believe  that  it  should 
have  heuristic  use  as  well. 

The  idea  which  prompted  the  present  research  was  that  biological  events 
may  be  predictive  of  the  attentlonal  and  task  demands  of  work.  If  these  could 
be  analyzed  in  real  time  and  fed  back  to  the  machine  (or  operator),  a  truly 
biocybernet lc  system  could  be  created.  For  example,  we  know  there  may  be 
little  or  no  deterioration  in  operational  performance  until  the  point  of 
failure  is  closely  approached  (Gopher  &  Donchin,  1986;  Schmidt.  1978),  but 
perhaps  sensitive  biological  measures  of  workload  could  provide  premonitory 
signs  of  impending  failure.  There  are  two  technical  developments  which  must 
be  accomplished  to  produce  a  workable  system.  One  is  t rad  1 1 Iona  1 ly  a  human 
factors  effort,  and  in  the  case  of  bioelectric  events,  neurophysiological  and 
biomedical.  The  other  entails  engineering  development,  including  software  and 
hardware.  In  this  work  we  have  set  out  to  accomplish  both,  but  the  emphasis 
has  always  been  on  the  former  rather  than  the  latter.  To  organize  our  present 
effort,  we  describe  a  2X7  c lass l f icat ion  schema  which  we  have  employed  to 
organize  our  present  effort.  We  believe  that  the  improved  descriptive 
precision  of  this  model  will  permit  Improved  communication  of  ideas.  The 
classif  icat  ion  follows  fr<xr.  statistical  theory  and  Its  assumptions,  and  we 
believe  that  it  should  have  heuristic  use  as  well. 

There  are  other  applications  for  validated  biocybernet ic  workload 
indices.  To  the  extent  that  such  workload  measures  also  follow  task  demands, 
they  could  be  employed  to  index  workload  character  1st les  of  military  systems 
during  various  stages  in  the  human  factors  engineering  design  and  subsequent 
evaluation.  It  is  generally  accepted  that  workload  is  a  function  of  task, 
operator  capabl 1 1 1 les ,  and  sequential  character  1st  les  (e.q..  practice  with 
task,  previous  workload  history,  etc.).  Moreover,  a  general  consensus  Is  that 
workload  Is  multidimensional  and  that  the  researcher  should  have  a  battery  of 
workload  metrics  at  his  or  her  disposal  (Bateman.  1979;  Crabtree,  Hateman, 
Acton,  1984;  Kggemeler,  1980;  Kggemeler,  TJhingledecker .  6  Crabtree.  1985; 
Frazier  6  Cromble,  1982;  Gopher  6  Donchin,  1986).  Kesearchets  are  determining 
whether  there  are  reliable  Indicants  of  individual  differences  in  information 
processing  skills  (Bonel,  Coles,  6  Benel.  1979;  Damos.  1984a, b.c;  l  tamos  6 
Smist,  1981:  Wlckens,  Mountford,  6  llchreiner,  1981).  By  assessing  workload’s 
impact  on  individuals  for  tasks  of  constant  difficulty,  workload  indices  can 
be  used  to  match  systems  according  to  the  reliable  Individual  differences  of 
the  user  population.  Then  better  decisions  can  be  made  selecting  between 
design  tradeoffs  (e.g.,  customize  for  individual  use,  design  In  "aided* 
systems,  or  automate  the  function).  Any  attempt  at  creating  a  biocybernet lc 
system  will  need  to  take  into  account  the  demand  character  1st ics  of  the 
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workload  prior  to  being  able  to  feedback  such  Information  so  that  the  system 
produces  less  workload. 

OVERVIEW 

This  project,  which  was  conceived  to  be  carried  out  in  three  phases, 
entails  the  investigation  of  a  physiological  output  of  the  human  organism  to 
be  employed  as  fedback  information  to  systems  in  order  reduce  task  loading  to 
acceptable  levels;  specifically,  an  eye  movement  index  of  mental  workload  was 
studied.  Phases  I  &  II,  funded  by  AFOSR,  have  been  completed  and  a  prototype 
is  available.  Future  plans  call  for  a  Phase  III  which  will  combine  Essex 
development  funding  with  federal  and  private  sector  support  in  order  to  make  a 
fully-up-and-runnlng  system  available  to  the  technological  community. 

In  Phase  I,  two  investigations  were  performed  to  assess  the  feasibility  of 
using  specific  character  1st lcs  of  eye  movement  saccades  as  unobtrusive 
indicants  of  mental  workload.  Eye  movements  were  measured  while  subjects  were 
differentially  task  loaded  by  simple,  moderate,  and  complex  auditory  tone 
counting.  The  results  indicated  that  the  extent  of  saccadic  eye  movements 
varied  inversely  in  subjects  as  tone  counting  complexity  increased.  Thus 
encouraged,  the  objective  of  the  Phase  II  work  was  to  further  develop  the 
SLIT.  This  was  done  through  Interlocking,  and  parallel  research  efforts 
involving  meta  analytic  literature  reviews,  and  experiments  and  protot/pe 
development  including  customized  software  for  data  acquisition  and  analysis. 

We  also  offer  a  model  which  we  use  descriptively,  but  which  has  heuristic 
applications.  In  what  follow;;  we  will  take  these  issues  in  turn,  but  first  we 
describe  why  we  investigated  characteristics  of  involuntary  eye  movements. 

RATIONALE 

Impetus  for  the  present  effott  began  with  the  finding  that  habituation  of 
the  fast  phase  component  of  vestibular  ocular  response  was  attenuated  in 
subjects  who  performed  a  vigilance  task  (Kennedy,  1972).  This  might  be 
expected,  it  was  argued,  since  t  tie  fast  phase  component  of  nystagmus  is 
dependent  on  the  integrity  of  the  reticular  formation  which  is  also  related  t<> 
arousal  and  alertness  (Cohen,  Feldman,  &  Diamond,  1969;  Darhoff  6  Hoyt,  1971; 
Yules,  Krebs,  &  Gault,  1966).  Given  that  other  research  related  nystagmus  to 
arousal  (Collins,  Crampton,  f.  Posner,  1961;  Collins  6  Posner,  1963),  the  idea 
was  pursued  to  relate  velocity  and  latency  of  saccades  to  performance  on  a 
task  which  could  he  varied  In  terns  of  the  demands  it  placed  on  the  operator. 

Thus,  Phase  I  (May,  Kennedy,  Williams.  Dunlap,  f>  Hrannan.  198b)  of  t  he 
present  effort  set  out  to  study  primarily  whether  eye  movement  form  was 
predictive  of  arousal  measured  as  performance  on  a  mental  task.  There  were 
two  studies  In  Phase  I.  Initially,  subjects  performed  an  auditory  tone 
counting  task  at  three  levels  of  difficulty  while  the  velocity  and  latency  of 
saccades  in  the  horizontal  plane  were  recorded.  The  "velocity  hyi»othosls"  was 
not  supported  -  saccade  velocities  obtained  during  the  baseline  condition  of 
free  viewing  did  not  differ  significantly  from  velocities  obtained  under  tone 
counting  conditions.  However,  in  this  study,  another  variable  (saccade 
latency)  appeared  to  vary  with  the  task  demands  but  practice  effects  and 
Individual  differences  in  performance  masked  the  relationship.  There  was  also 
the  suggestion  that  the  length  of  a  saccade  may  provide  information  about  task 


demands.  It  should  also  be  mentioned  that  while  we  did  not  find  support  for 
our  hypothesis  in  Phase  I,  we  also  did  not  have  convincing  evidence  against  it 
since  there  were  known  limitations  in  sampling  rate  and  recording  sensitivity 
of  the  technique  employed. 

The  second  Phase  I  experiment  used  the  same  equipment  and  explored  further 
the  relationship  of  eye  movement  measures  (saccade  length)  to  workload.  At 
this  point  we  also  incorporated  findings  from  the  literature  on  eye  movement 
extent  where  preliminary  experimental  evidence  showed  extent  of  eye  movements 
might  be  reduced  under  conditions  which  Induced  high  levels  of  arousal.  For 
example,  Malmstrom  (with  Reed,  1983;  and  with  Reed  &  Randle.  1983)  reported  a 
restriction  of  pursuit  eye  movement  range  during  a  concurrent  auditory  task 
and,  more  pointedly,  Cromroellnck  and  Roucoux  (1976)  found  that  restriction  In 
saccade  length  occurred  In  cats  under  conditions  of  high  arousal  Induced  by 
amphetamines. ' 

Therefore,  to  test  the  relationship  between  saccade  length  and  arousal, 
subjects  in  the  second  Phase  I  experiment  performed  an  auditory  tone  counting 
task  at  three  levels  of  difficulty  while  saccadic  eye  movements  were 
recorded.  The  mean  range  of  eye  movements  in  the  horizontal  plane  for  each  of 
the  three  workload  conditions  are  presented  in  (Table  1)  along  with  mean 
performance  on  the  tone  counting  task.  As  seen  In  the  table,  performance 
varied  inversely  wltt.  difficulty  level  of  the  tone  counting  task  suggesting 
that  'he  different  task  conditions  induced  different  levels  of  mental 
workload.  This  relationship  was  substant iated  by  a  significant  linear  trend 
(F(l,4)  :  9.10,  p  1  .0393).  Average  extent  of  saccadic  eye  movements  was  also 

related  to  task  difficulty  so  that  saccade  length  was  restricted  with 
Increased  task  difficulty  level  (F(l,4)  =  16.6b,  p  .02).  To  further 

substantiate  the  relation  of  saccade  length  to  workload,  correlation 
coef f ic ierit s  between  saccade  length  and  performance  were  computed  for  each 
subject.  The  correlations  ranc-d  from  r  =  .37  to  r  .99  with  a  mean  of  r  - 

r 

.64.  Thus ,  the  results  from  t"  ■>  research  suggested  that  saccade  length  could 
be  a  promising  objective  measure  of  the  task  demands  of  a  display  and  thereby 
serve  as  a  useful  measure  of  mental  ’workload. 


TAHI.K  l.  Normalized  Spontaneous  Saccade  l.ength  ami  Tone 
Counting  Performance  (Percent  Correct)  as  a  Function  of  Task  Difficulty 


Task  bl f  f icu 1 1  y 


Low 

Med  1 um 

High 

Saccade  l.ength 

Mean 

3.2b 

3.01 

2.44 

(fiU) 

(2.30) 

(3.08) 

(2.32) 

Per  formance 

Mean 

0.96 

0.82 

0.64 

(Percent  Correct) 

(SO) 

(0.09) 

(0.19) 

(0.23) 

DESCRIPTION  OP  PROJECT  GOALS 


The  purpose  of  Phase  II  is  to  develop  further  the  SLIT  and  cross-validate 
the  results  of  Phase  I.  The  ultimate  outcome  of  Phase  II  would  be  prototype 
development  of  a  transportable  system  to  assess  mental  workload  via  the  SLIT 
metric  and  other  bioelectric  measures  as  appropriate.  A  chief  Ingredient  in 
Initial  development  of  such  a  system  would  be  a  focus  on  rapid  (l.e.,  seconds) 
evaluation  of  the  bioelectric  events  so  that,  when  properly  identified  and 
classified,  such  signals  could  be  fed  back  to  signal  generators.  There  were 
several  key  technical  issues  which  needed  resolution  (Table  2)  and  these  were 
the  focus  of  much  of  our  endeavors.  This  work  was  divided  into  three  main 
thrusts:  Meta-analysls,  Experimentation,  and  Software  Development.  These  are 
outlined  in  the  later  sections. 


TABLE  2.  Key  Technical  Issues  for  Phase  II  SLIT  Program 


Descript  Ion 

1  Establish  the  relationship  between  the  saccade  length  index  of 
taskload  and  task  performance. 

2  Determine  the  validity  of  St. IT  procedures  when  visual  tasks  are 
employed . 

3  Examine  the  effects  of  practice  on  SLIT. 

4  Extend  SLIT  to  include  vertical  as  well  as  horizontal  eye 
movements. 

5  Modify  SLIT  to  reject  eyeblink  artifacts  using  binocular 
recording . 

6  Compare  SLIT  to  other  physiological  indices  of  workload. 


Meta-Analy sis  and  Literature  Cat  a  1 ogue 

To  help  us  plan  experiments  we  went  to  the  scientific  literature  on 
workload  (e.g.,  Aasman.  Mulder.  &  Mulder,  1987;  Acosta  &  Hickman.  1984;  triers 
&  Masline,  1987;  Hart  &  Bortolussi,  1984;  Mane  &  Vickens,  1986)  as  well  as  to 
conference  proceedings,  literature  reviews  and  listings  of  research.  We 
employed  the  work  of  Casalll  and  Wierwille  and  their  colleagues  as  a  model  and 
fol lowed  their  taxonomy.  This  had  the  advantage  of  permitting  comparison  of 
data  collected  using  the  same  subjects,  tasks,  and  procedures.  First,  we 
catalogued  the  literature,  tabular Ized  them,  and  then  surfaced  studies  for  the 
meta-analysls  which  we  employed  as  a  context  in  which  to  regard  our 
experimental  findings. 

For  the  meta  analysis  (Green  &  Hall,  1984),  separate  studies  having 
similar  objectives  and  data  presentation  formats  were  compared  on  a  common 
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metric.  Por  this  quantitative  literature  review,  we  were  primarily  Interested 
In  those  bloloqlcal  events  which  emanated  In  the  eye  and  were  related  to 
workload  (narrowed  visual  field,  pupillary  dilation,  eye  movement  extent, 
eyebllnks,  fixation  fraction,  nystagmus,  and  event-related  potentials). 

In  connection  with  the  literature  cataloguing  two  useful  by-products 
emerged: 

o  In  Tables  10-13,  the  majority  of  the  experimental  work  done  since  1970  is 
organized  by  the  type  of  workload  metric,  authors,  date,  and  publication. 
These  tables  may  be  used  to  discern  general  trends  in  this  area. 

o  Because  of  the  number  of  titles  we  scanned,  we  were  able  to  create  a 

computer-based  workload  bibliography  containing  over  600  entries.  A  hard 
copy  of  the  bibliography  appears  as  Appendix  A.  The  bibliography  Is  also 
on  disk  AND  may  be  used  with  commercial  software  programs  such  as  d-base. 
Copies  of  this  disk  are  available  from  the  Principal  Investigator  (Robert 
S.  Kennedy,  Ph.D.,  Essex  Corporation,  1040  Woodcock  Road,  Orlando,  FL, 
32S03).  We  believe  that  quite  apart  from  the  written  report,  of  which  It 
Is  a  part,  a  computer-based  bibliography  In  this  format  offers 
significant  advantages  over  hard  copy  In  that  sorting  may  be  done  by 
author,  key  words,  date,  etc.,  at  the  Investigator's  choice.  A 
computer  based  bibliography  may  then  become  part  of  the  next 
investigator’s  data  base  and  be  updated,  added  to,  annotated,  etc.,  with 
little  difficulty. 

EXPERIMENTAL  EFFORT 

We  performed  a  series  of  experiments  in  which  the  Phase  I  finding  of 
restricted  saccade  length  during  higher  workload  was  replicated.  We  also 
studied  its  appllcabl 1 lty  to  new  situations  and  extended  our  knowledge  of  the 
SLIT  metric.  Specif  leal ly .  we  examined  the  effects  o!  practice  on  SLIT  and 
demonstrated  the  generality  of  the  SLIT  techniques.  The  results  show  that  the 
SLIT  phenomenon  Is  robust  and  the  metric  is  stable.  Even  though  large 
Improvements  in  performance  occurred  with  practice,  the  validity  of  SLIT  as  a 
workload  metric  did  not  change.  Second,  SLIT  is  not  limited  to  auditory 
performances  which  occur  In  the  dark  the  metric  appears  to  be  appropriate 
while  tasks  which  require  visual  monitoring  are  performed.  Additionally,  when 
moving  visual  environments  which  Induce  reflexive  eye  movements  were  created, 
the  SLIT  responses  were  still  measureable .  Below  in  our  development  section 
we  address  the  Independence  of  SLIT  and  eyeblink;  at  least  the  two  metrics  do 
not  appear  to  covary.  The  question  of  overlap  and  which  may  be  the  better 
metric  will  take  considerable  exploration,  but  a  provocative  design  question 
can  be  framed  using  the  descriptive  model  of  workload  explained  below. 

SOFTWARE  DEVELOPMENT  EFFORT 

In  this  part  of  the  work  we  used  analyses,  demonstrations,  and  software 
to  produce  a  customized  scoring  technique  which  permitted  nearly  immediate  (10 
seconds)  analysis  and  reporting  of  data.  Additionally,  we  demonstrated  proof 
of  concept  in  the  recording  of  both  eyes  as  well  as  vertical  and  horizontal 
movements.  By  software  techniques  we  were  able  to  Isolate  the  SLIT  metric 
from  eyebllnks,  saccadic  frequencies,  velocities  and  other  measures.  In 
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feasibility  studies  three  subjects  were  employed  and  the  examination  of  the 
relationships  between  eyeblink  and  SLIT  measures  Implied  independence. 

Graphic  and  numerical  printouts  of  the  data  are  also  available.  This 
technique  Is  easily  adaptable  to  most  laboratory-based  pc  systems  and  is  as 
portable  as  the  computer  used  for  analysis. 

MODEL  OF  WORKLOAD 

Like  the  field  of  stress,  and  partly  for  the  same  reasons,  we  believe 
there  are  logical  inconsistencies  in  the  workload  literature.  Por  example: 

(a)  workload  measures  are  often  dichotomized  into  objective  and  subjective 
measures;  but  (b)  most  measurement  of  mental  workload  can  also  be  dlvlslblle 
into  two  other  primary  categories  --  Operator  DEPENDENT  and  Operator 
INDEPENDENT.  These  two  classification  schemata  are  neither  synonomous  nor 
mutually  exclusive,  although  the  literature  search  nowhere  appears  to  make 
this  point.  Por  example,  there  are  subjective  metrics  which  are  operator 
dependent  (e.g.,  like  Cooper/Harper  scales  (1969J)  and  there  are  some  which 
are  (or  are  Intended  to  be)  operator  Independent  (like  the  Subjective  Workload 
Assessment  Technique).  We  believe  that  by  application  of  this  2X2  model, 
different  outcomes  can  be  predicted  to  occur  depending  on  the  cell  from  which 
a  particular  metric  Is  selected.  On  this  view,  logically  some  analyses  may  be 
unwarranted  when  metrics  arise  from  different  sets  of  assumptions.  Therefore, 
we  believe  that  this  descriptive  model  also  has  heuristic  value. 

META  ANALYSIS  AND  LITERATURE  CATALOGUE 

This  section  of  the  report  outlines  a  quantitative  meta  analysis 
organized  by  a  2X2  class! f lcat Ion  model  and  based  on  an  application  of  the 
point  blserial  correlation  coefficient.  The  meta  analysts  is  followed  by  an 
in-depth  literature  catalogue  of  relevant  studies  available  in  the  open 
literature  since  1970. 

THE  PROBLEM 

Workload  is  a  hypothetical  construct  which  relates  to  the  attentlonal 
demands  of  a  task  and  is  considered  to  be  one  of  the  many  determinants  of 
human  performance.  O'Donnell  and  Eggemeier  (1986)  propose  that  initially,  at 
low  levels,  increasing  workload  has  little  effect  on  performance,  with 
moderate  to  high  workloads,  however,  performance  begins  to  deteriorate,  slowly 
at  first  and  then  more  steeply.  Other  conditions  enter  into  the  determination 
of  workload  for  a  given  person  at  a  given  time.  Experience  or  practice,  for 
example,  reduces  workload.  The  same  task  requirements  impose  a  lighter  burden 
on  a  skilled  person  than  on  a  less  skilled  one.  Time  on  task  also  affects 
workload.  There  are  also  major  group  differences  in  how  much  workload  the 
same  task  Imposes.  Sex,  age,  and  various  aptitude  categories  are  all  relevant 
in  this  connection.  Finally,  of  course,  workload  varies  from  one  individual 
to  another. 

The  complexity  of  this  situation  has  made  it  more  desirable  than  usual  to 
have  adequate,  objective  measures  of  workload.  An  operator,  of  course,  can  be 
asked  to  report  how  onerous  a  task  is  and,  in  fact,  subjective  judgments  of 
workload  are  probably  the  best  behaved  measures  of  workload  available  (Gopher 
t  Braune,  1984).  Nevertheless,  they  are  still  subjective,  and  scientific  bias 
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favors  objective  measures;  at  the  very  least,  one  should  try  to  develop  such 
measures . 

A  DISTINCTION 

We  take  the  position  that  the  literature  on  workload  Indicants  has  been 
somewhat  clouded  by  ambiguous  usage  of  the  word  "subjective."  To  address  this 
ambiguity,  we  propose  that  the  dichotomy  of  operator  DEPENDENT  measures  versus 
operator  INDEPENDENT  measures  be  added  to  the  usual  distinction  between 
SUBJECTIVE  versus  OBJECTIVE  measures.  For  example,  on  the  one  hand,  workload 
has  been  used  to  mean  self-report  or  any  measure  derivative  from  self-report 
(Boff  &  Lincoln,  1988;  e.g.,  pp.  1640,  1642).  On  the  other  hand,  it  includes 
measures  which  systematically  vary  within  an  Individual,  which  we  refer  to  as 
operator-dependent  measures.  To  clarify  the  distinction,  consider  eyebllnks. 
The  number  of  eyebllnks  an  operator  makes  In  a  standard  interval  of  time  is  a 
strictly  objective  measure;  it  does  not  depend  in  any  way  with  self-report  by 
the  operator.  One  can  count  eyebllnks  without  benefit  of  any  communication 
whatsoever  from  the  operator.  Neverthelsss.  number  of  eyebllnks  is  also 
operator  dependent;  it  varies  widely  from  one  operator  to  another  under  the 
same  conditions. 

Table  3  presents  a  classification  of  workload  measures,  according  as  they 
are  subjective  or  objective  and  operator -dependent  or  operator- independent . 

The  upper  row  Includes  all  operator- dependent  measures.  Self  report  by  the 
operator  is  subjective.  Objective  (operator  dependent)  measures  Include 
variations  in  eye  movements,  pupillary  dilation,  evoked  response  potentials, 
eyebllnks,  heart  rate,  and  of  course,  much  else. 

In  Table  3,  the  lower  row  includes  operator  independent  measures.  In 
most  experiments,  workload  is  specified  by  fixing  the  properties  of  a  task. 

The  properties  fixed  are  usually  the  amount  of  information  the  operator  must 
process,  its  complexity,  or  Intervals  of  time  between  presentation  of  the 
material  and  allowable  response  (mnemonic  demands).  These  specifications  of 
workload  are  strictly  objective.  They  do  not  depend  on  self  report  from 
anyone.  However,  operator  Independent  specification  may  also  be  subjective. 

It  may  Involve  self- report  or  Judgment,  if  you  like,  but  the  self  or  Judge  is 
not  the  operator  but,  rather,  the  investigator  or  some  other  expert.  The 
Subjective  Workload  Assessment  Technique  (SWAT)  (Reid,  Shingledecker ,  6 
Eggemeler,  1981)  is  a  case  in  point.  In  this  approach  a  trained  expert 
evaluates  a  task,  using  a  standardized  technique,  and  assigns  it  a  rating. 

SWAT  is  a  subjective,  albeit  formalized  procedure  that  does  not  depend  on 
self  report  by  the  operator.  Hence,  it  fails  into  the  lower  left  hand  corner 
of  the  2X2  table. 
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TABLE  3.  A  Classification  of  Workload  Measures 


Examples 


Operator 

Dependent 

Subjective 

Cooper -Harper 

Oblective 

Eye  Blinks 

Heart  Rate 

Errors 

Latencies 

Subjective 

Informational 

operator 

Workload 

Demand  or 

Independent 

Assessment 

Complexity 

Scale  (SWAT) 

* 

Entries  in  the  cells  are  examples  of  the  four  kinds  of  workload  measures. 


Operator  INDEPENDENT  techniques  are  based  primarily  on  task  descriptions 
such  as  time  between  presentation  of  stimuli,  Information  bits,  and  number  of 
Information  sources.  Use  of  task  descriptions  to  quantify  workload  Is  common 
to  most  research  In  which  the  Intent  Is  to  assess  workload  measurement 
techniques.  Often,  and  appropr lately ,  task  difficulty  Is  Independently 
verified  prior  to  Its  use  to  validate  measures  of  workload  (Bortolussl, 
Kantowltz  &  Hart,  1985;  Hart,  Childress.  &  Bortolussl,  1981). 

Operator  DEPENDENT  techniques  Include  workload  definitions  based  on  the 
operator  response.  These  Include:'  (a)  subjective  Indices,  (b)  task 
performance,  and  (c)  physiological  measures. 

Subjective  Indices  are  operator  ratings  of  task  difficulty  and  task 
attentlonal  demands  obtained  via  debriefing  Interviews  and  questionnaires. 

For  example,  the  Multi  descriptor  Scale  used  by  Casall  (1982)  requires  that 
operators  rate  task  demands  according  to  each  of  six  descriptors  (l.e., 
attentlonal  demand,  error  level,  difficulty,  task  complexity,  mental  workload, 
and  stress).  The  average  of  these  six  ratings  Is  used  as  a  measure  of  mental 
workload.  Gopher  and  Braune  (1984)  argue  that  a  psychophysical  scaling 
approach  can  be  adapted  to  the  measurement  of  workload  based  on  subjective 
estimates.  As  Indicated  In  Table  11,  subjective  methods  of  workload 
assessment  are,  apart  from  performance  measures,  the  most  commonly  employed 
workload  assessment  tool,  most  likely  because  that  ace  easily  administered, 
low  In  cost,  and  require  minimal  to  no  Instrumentation.  Disadvantages  Include 
Interruption  of  task  to  obtain  ratings,  operator  bias,  and  low  or  at  least 
poorly  understood  correlation  with  measures  of  performance  (Gopher  &  Braune. 
1964;  Gopher,  Chillag,  t  Arzl,  1905;  Vldullch  &  Wlckens,  1964,  1965;  wlckens  & 
Yeh,  1983;  Yeh  &  Wlckens.  1984.  1985). 

Task  performance  indices  are  based  upon  the  assumption  that  decreasing 
performance  results  from  Increasing  workload.  Examples  of  performance 
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■easures  Include  number  of  errors,  percent  correct,  response  tine,  and 
deviation  from  an  optimal  flight  path.  A  common  performance  measure  technique 
is  to  measure  operator  performance  on  a  secondary  task  (Wlckens.  1964).  For 
example,  Vlerwllle  and  Connor  (1983)  assigned  a  primary  task  to  subjects 
(i.e.,  straight  and  level  simulated  flight)  simultaneously  with  secondary 
tasks  (e.g.,  mental  arithmetic).  Given  a  constant  level  of  workload  on  the 
primary  task,  the  performance  on  the  secondary  task  is  thought  to  represent 
"residual  resources”  or  "spare  mental  capacity”  (Kantowitz  &  Sorkin,  1983). 
Performance  variations  on  the  secondary  task  are  thus  presumed  to  measure 
workload  imposed  by  the  primary  task  which  are  not  reflected  by  performance  on 
the  primary  task.  Disadvantages  of  performance  measures  include  the  uncertain 
relationship  between  performance  and  workload.  Moreover,  when  secondary  tasks 
are  employed,  it  is  essential  that  the  primary  task  remains  primary,  a  problem 
not  always  handled  satisfactorily  (Damos,  Bittner.  Kennedy,  &  Harbeson,  1981; 
Kantowitz  &  Weldon,  1985). 

Finally,  physiological  measures  have  been  extensively  utilized  to  .measure 
capability  to  perform  physical  workloads,  As  a  logical  extension,  and  in  view 
of  the  working  assumption  that  cognitive  functions  have  an  underlying 
physiological  basis,  measures  of  physiological  responses  have  been  extensively 
employed  as  an  Indices  of  mental  workload.  Examples  include  measures  of 
cardiovascular,  brain,  respiratory,  and  visual  functions.  While  physiological 
measures  have  potential  In  providing  a  proxy  (Lane,  Kennedy,  £  Jones,  1986) 
index  for  mental  workload  (Donchln  &  Kramer.  1986;  bonchln,  wlckens.  &  Cole, 
1983;  Frazier.  1966;  Kennedy,  1978;  Lewis,  1983  a.b;  McCloskey,  1987; 
O'Donnell,  1981;  O'Donnell  6  Shlngledecker ,  1986;  O'Hanlon,  1971;  Wilson, 
O'Donnell,  &  Wilson.  1982:  Wilson.  Purvis.  Skelly,  Fullenkamp,  &  Davis,  1987; 
Yolton,  Wilson,  Davis,  6  McCloskey.  1987),  they  may  reflect  stress  rather  than 
cognitive  load  (Shlngledecker,  1982).  and  rarely  account  for  a  large 
proportion  of  the  variance  In  the  criterion. 

It  is  clear  that  from  the  available  scientific  literature  no  sin, 
subjective,  task,  or  response  measure  has  allowed  mental  workload  to  be 
reliably  and  objectively  quantified.  Persistent  barriers  to  satisfactory 
measure  of  mental  workload  Include:  (l)  Inadequate  conceptual izat ion  of  mental 
workload  (e.g.,  Aunon,  Kantowitz,  McGlllem,  6  Plonski,  1987;  Kantowitz  & 
Sorkin,  1983),  (2)  task  dependent  nature  of  many  workload  techniques  (e.g., 
McCloskey,  1987;  Wierwille,  Kahimi,  6  Casali,  1985),  (3)  and  lack  of 
methodologies  to  handle  human  differences  in  task  demands  such  as  extent  of 
practice  on  task,  previous  workload,  ability  or  skill  level  (e.g.,  Matthews, 
1986). 

This  distinction  between  operator- dependent  and  operator  Independent 
measures  is  not  artificial.  It  corresponds  closely  to  the  more  familiar  one 
between  random  and  fixed  factors  In  experimental  design.  A  typical  experiment 
on  workload  indicants  uses  operator  independent  specifications  as  treatment 
conditions.  Thus,  the  tasks  that  subjects  are  asked  to  perform  may  be 
characterized  (usually  according  to  objective  parameters)  as  light,  moderate, 
or  heavy.  In  the  experimental  design  these  three  specifications  are  levels  of 
a  treatment  factor  called  "workload."  The  factor,  moreover.  Is  fixed.  The 
analysis  proceeds  on  the  assumption  that  the  experiment  could  be  replicated 
using  the  same  specifications  for  the  workload  factor  without  error  or,  more 
accurately,  without  sampling  error. 


12 


The  subjects  in  this  typical  experiment  are  studied  with  respect  to  their 
responses  while  performing  the  tasks  assigned  them.  These  responses,  whether 
subjective  or  objective,  are  operator-dependent.  In  the  experimental  design 
the  operator  response  (or  indicant)  appears  as  a  random  factor,  either  nested 
within  treatment  conditions  (as  in  a  factorial  experiment)  or  crossing  them 
(as  in  a  repeated-measures  design). 

Failure  to  draw  these  distinctions  can  lead  to  serious  confusion.  It  is 
possible  and  sometimes  useful  to  correlate,  in  the  sense  of  the  Pearson 
Product -Moment  Correlation  Coefficient,  two  operator-dependent  measures  of 
workload.  The  unit  of  analysis  in  such  a  correlation  is  the  individual 
operator.  One  might  want  to  know,  for  example,  how  well  an  objective, 
operator-dependent  Indicant  of  workload  on  one  task  predicts  operator  reported 
workload  on  another.  One  might  want  to  Intercorrelate  operator-dependent 
indicants  with  a  view  to  determining  their  dimensionality,  as  in  factor 
analysis.  All  such  analyses  take  place  within  the  upper  row  in  Table  3. 

It  is  also  possible  to  correlate  operator-dependent  and 
operator- Independent  measures.  In  any  such  case,  however,  one  of  the  two 
variables  being  correlated  is  fixed  (the  operator-dependent  treatment 
condition)  and  the  other  random,  whereas  two  operator-dependent  measures  are 
both  random.  Any  text  on  correlational  analysis  points  out  the  difference 
between  these  two  situations.  At  the  sample  level,  the  calculations  are  much 
the  same,  but  the  models  used  to  analyze  these  calculations  and  to  test  the 
significance  of  the  results  are  fundamentally  different.  Any  quantitative 
review  of  this  field  must  take  this  into  account.  Stated  differently,  when 
the  experimental  design  looks  at  relationships  between  elements  of  different 
classes  expectedly  these  should  be  lower  than  those  within  classes. 

In  a  typical  experiment,  workload  treatment  conditions  are  specified  in 
objective,  operator  independent  terms.  Operator- independent  indicants  may  be 
either  subjective  or  objective  but  the  focus  in  the  present  report  will  be 
primarily  on  objective  (visual)  indicants.  The  goal  of  the  experimental  work 
reported  here  is  a  blocybernet ic  indicator  of  workload.  The  studies, 
therefore,  that  we  will  be  examining  involve  the  two  cells  of  the  right  hand 
column  of  Table  3.  The  question  at  issue  will  be  how  well  the 
operator-dependent  visual  (or  other)  indicants  differentiate  between  the 
equally  objective  workload  treatment  conditions.  If  subjects  (operators) 
respond  very  differently  under  the  several  workload  conditions,  it  may  be 
possible  to  infer  from  the  subject’s  response  which  treatment  condition  he  or 
she  is  in.  Of  course,  it  may  also  be  that  the  operator  response  in  different 
treatment  conditions  overlap  heavily,  in  which  case  it  is  not  possible  to 
infer  the  treatment  condition  from  the  operator's  response  with  much  assurance. 

The  design  Just  described  is  called  in  other  are  is  of  research  a 
"biological  assay.”  An  organism's  response  is  used  to  grade  or  rate  the 
objective  conditions  under  which  the  response  is  made.  A  precondition  of 
successful  biological  assay  is  that  subject  responses  be  well  separated  under 
substantially  different  treatment  conditions.  The  approach  to  workload  by 
looking  at  objective,  operator-dependent  Indicants  is  thoroughly  orthodox,  but 
it  does  not  necessarily  succeed.  Everything  depends  on  how  well  the  Indicants 
"follow"  or  are  correlated  with  imposed  workload  conditions.  If  the 
correlation  between  Indicant  and  workload  conditions  is  "sufficiently  high"  it 
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•ay  Mice  sense  to  grade  the  workload  conditions  according  to  the  mean  operator 
response.  But  what  precisely  are  we  to  use  In  order  to  index  this 
"correlation"?  The  next  step  in  the  anlaysls  must  be  to  settle  on  a  measure 
of  correlation  appropriate  to  the  task  at  hand.  In  the  terminology  of 
neta- analysis  (Oreen  &  Hall,  1984)  we  need  to  specify  a  measure  of  effect  size. 

BFPBCT  SUB 

The  Masure  of  effect  size  used  in  this  report  will  be  the  point  biserlal 
correlation  coefficient.  This  measure  applies  to  the  relationship  between  a 
dichotomous  variable  and  a  fully  quantitative  one.  It  Is  obtained  by  scoring 
the  dichotomy  0  and  1  (or  any  other  two,  distinct  values)  and  calculating  the 
Pearson  product -moment  correlation  coefficient.  In  short,  the  point  biserial 
is  a  variant  of  the  Pearson  £  in  which,  on  one  variable,  many  subjects  all 
have  the  same  score  (0)  and  the  rest  all  have  another  same  score  (1). 

In  an  experimental  context  the  number  of  subjects  assigned  to  two 
treatment  conditions  is  usually  the  same.  This  is  true  for  the  papers  which 
were  analyzed  in  this  report,  but  even  if  the  sample  sizes  varied,  it  would 
still  be  correct  procedure  to  treat  the  two  sample  sizes  as  the  same,  provided 
that  the  pooled  withtn-group  variance  took  account  of  the  different  sample 
sizes.  Sample  size  is  arbitrary  in  an  experiment.  Hence,  when  sample  sizes 
are  not  the  same,  they  could  have  been  set  to  be  the  same  and  the  means  and 
variances  would  not  change  systematically  with  variable  sample  size. 

Given  that  the  two  sample  sizes  are  the  same,  the  most  useful  form  of  the 
point  biserlal  is  the  following: 

-rPb  3  ((Y1  ‘  Yo>/2>/(<<Yl  Yo>/2>  ♦  s?  w)l/2 

If  we  know  the  means  under  the  same  two  treatment  conditions  (Yi  and  Y0. 
and  the  pool  within  group  variances  (s2  w).  £pb  is  simply  calculated. 

The  square  of  the  point  biserlal  is  easily  shown  to  equal  the  ratio  of  the 
between- group  to  the  total  sum  of  squares. 

There  are  two  main  reasons  for  choosing  the  point  biserlal.  The  first 
has  already  been  mentioned,  namely,  its  relationship  to  the  product  moment  r. 
The  Pearson  coefficient  is  a  familiar  and  widely  understood  statistic,  and 
roost  psychologists  have  at  least  a  few  "pegs"  by  which  to  gauge  the  magnitude 
of  a  given  value.  They  know,  for  example,  that  r  -  .90  is  an  acceptable 
test- retest  reliability  coefficient  or  that  r  3  .40  is  a  good  predictive 
validity  for  on  the  job  performance. 

The  second  reason  has  also  been  alluded  to,  namely,  the  relative  ease  of 
extracting  a  point  biserlal  from  a  published  paper.  No  measure  of  effect  size 
can  be  extracted  from  every  scientific  paper  or,  usually,  even  roost  papers: 
but  means  and  standard  deviations  are  the  most  commonly  reported  of  all 
statistics  and  a  measure  like  the  point  biserlal  that  requires  no  additional 
InforMtlon  is  as  likely  to  be  calculable  from  available  Information  as  any 
measure  of  effect  size.  Sometimes,  moreover,  the  point  biserlal  can  be 
extracted  even  %rtten  means  and  standard  deviations  are  not  reported.  It  can, 
for  example,  be  extracted  from  a  tstatistlc  or  an  ANOVA  table  with  one  degree 
of  freedom  for  the  workload  treatment  factor.  It  can  even  be  calculated  from 
proportions  of  "successful"  subjects  under  two  conditions. 
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There  ere,  of  course,  some  drawbacks  also.  The  point  blserial  applies  to 
dichotomies.  If  an  Investigator  imposes  three  workload  conditions  (light, 
aoderate,  and  heavy),  all  three  cannot  be  evaluated  with  a  single  point 
blserial.  Instead,  one  needs  three  point  blserlals,  one  for  each  of  the  three 
possible  pairwise  cooper Isons.  These  three  comparisons,  moreover,  are  not 
themselves  fully  comparable.  The  llght/heavy  comparison  should  yield  a 
substantially  higher  value  than  the  two  comparisons  between  adjacent  levels. 

Conventionally,  it  is  not  recommended  that  one  use  a  point  blserial 
excluding  a  middle  category.  The  reason  is  that  the  resulting  £pb  seriously 
overestimates  the  population  r.  In  the  context  of  a  meta-analysis,  however, 
rpb  is  not  used  to  estimate  a  population  r  but,  rather,  to  gauge  the  extent 
of  differentiation  between  two  treatment  conditions.  It  is,  of  course, 
necessary  to  bear  in  mind  "how  far  apart"  two  treatment  conditions  are  when 
quoting  an  rpt>. 

This  question,  however,  of  how  far  apart  two  conditions  are  has  to  be 
faced  in  any  event.  Even  if  the  dichotomous  variable  were  fully  quantitative, 
and  we  were  using  a  conventional  product -moment  correlation,  it  would  still  be 
necessary  to  consider  how  far  apart  the  values  were  over  which  the  workload 
factor  or  variable  ranged.  In  short,  the  necessity  of  considering  the 
distance  between  two  levels  of  a  workload  factor  does  not  oblige  us  to  do 
anything  we  would  not  have  to  do  anyway,  albeit  in  a  subtler  form  and  one  that 
might  quite  probably  be  missed  altogether. 

THE  CASALIWIERWILLE  EXPERIMENTS 

Krora  1983  8b.  Casall  and  vierwllle  published  four  studies  on  indicants  of 
workload  which  together  constitute  a  landmark  in  the  field.  All  Four  studies 
used  similar  methodologies  and  multiple  operator  dependent  Indicants  of 
workload,  both  sub)-'  t Ive  and  objective.  Since  these  various  indicants  were 
all  studied  under  the  same  Imposed  conditions  of  operator  independent 
workload,  the  resulting  point  blserlals  are  comparable  in  a  way  that  rpb 
from  different  studies  with  differentially  specified  workload  conditions 
cannot  be.  Since  the  indicants  were  also  quite  diverse,  the  Casall  Wlerwllle 
studies  provide  an  excellent  framework  within  which  to  locate  the  visual 
tndlcants  which  are  our  primary  concern. 

Table  4  presents  the  findings  from  the  Casal l  Wlerwll le  studies,  where 
the  indicants  have  been  classified  into  four  groups:  judgment,  vision,  other 
physiological,  and  task  (primary  or  secondary).  The  judgment  indicants  were 
subjective,  a  modified  Cooper  Harper  or  Multi  descriptor  scale;  the  visual 
indicants  were  eyebllnks  and  fixation  fraction;  other  physiological  measures 
were  heart  rate;  and  the  task  indicants  were  control  movements,  error  rates, 
and  reaction  times.  Table  4,  it  should  be  pointed  out.  includes  only  those 
Indicants  that  showed  a  significant  overall  ANOVA.  Table  4,  therefore, 
presents  the  best  indicants  In  these  four  categories.  Vhat  we  see  Is  not  a 
representative  figure  but  the  most  that  <  n  be  «* pec ted  of  the  Indicants  that 
Casall  and  Wlerwllle  studied  In  these  four  categories.  Table  4  gives  the 
maximum  blserial  observed  In  a  category,  the  average  rPb  in  that  category, 
and  (on  the  left)  the  number  of  rpb  on  which  that  average  is  based. 
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TABLE  4.  Effect  Size  by  Category  of  indicant 


Point  Blserlal  r 


Q&&S32DL 

N 

Maximum 

Averaae 

Judgment 

ll 

.816 

.499 

Vision 

9 

.696 

.298 

Other  Psychological* 

3 

.215 

.145 

Task 

27 

.854 

.552 

*  Heart  rate 


Proa  these  results  it  appears  that  subjective  and  task  indicants  are 
better  than  visual  Indicants,  which  in  turn  are  better  than  heart  rate  (other 
physiological).  The  relatively  high  values  for  subjective  indicants  was  to 
have  been  expected.  As  noted  earlier,  subjectives  are  usually  better  behaved 
than  other  indicants.  However,  as  was  also  noted  earlier,  the  whole  thrust  of 
this  report  and  of  most  of  the  literature  on  workload  indicants  is  to  get  away 
from  subjective  Indicants. 

The  rpb  for  task  indicants  are  unexpectedly  high.  Judging  from  the 
O’Donnell  and  Eggwmeier  account  of  the  workload  performance  relationship,  one 
would  have  expected  lower  values.  Even,  however,  if  task  indicants  are  as 
strongly  related  to  operator  independent  workload  conditions  as  they  appear  to 
be  in  Table  4.  they  are  still  seriously  flawed  on  other  counts.  Biological 
assays  for  workload  are  Intended  to  provide  a  means  of  grading  or  rating  a 
large  variety  of  real  world  tasks.  If.  however,  task  indicants  were  to  be 
used  to  register  operator  responses,  then  different  tasks  would  frequently  or 
usually  Involve  different  Indicants.  This  fact  would  entail  '  <*>  crippling 
difficulties,  one  theoretical  and  one  pragmatic.  The  theoretical  difficulty 
is  that  different  task  indicants  would  involve  different  units  and,  therefore, 
be  noncommensurate.  The  pragmatic  difficulty  is  that  multiple  Indicants  would 
make  the  work  of  standardizat ion  many  times  more  difficult  than  It  might 
otherwise  be. 

Despite  their  high  values,  neither  subjective  nor  task  Indicants  meet  the 
requirements  we  have  set  ourselves.  That  leaves  us  with  visual  and  other 
physiological  indicants.  Judging  from  the  heart  rate  results  in  Table  4, 
other  physiological  Indicants  held  little  promise. 

%»e  are  left  with  visual  Indicants.  Accordingly,  the  literature  on  visual 
indicants  of  workload  was  surveyed  and  culled  for  papers  which  seemed 
appropriate  for  our  purposes.  A  total  of  25  papers  were  located  and  analyzed, 
where  possible,  using  the  point  biserlal  metric. 

SURVEY  OF  VISUAL  IMDICAMTS 

Candidates  for  a  visually  Based  Eve  Movement  Indicant  of  Went a  1  Work  load 

Of  particular  Interest  to  this  report  is  the  potential  of  monitoring 
activity  of  the  visual  system  to  quantify  mental  workload.  In  view  of  the 


central  role  of  eye  movements  In  visual,  cognitive,  and  refined  motor 
activities  (cf..  Table  13),  it  is  not  surprising  that  numerous  studies  have 
related  various  quantitative  aspects  of  eye  movements  to  attention,  cognitive 
performance,  mental  effort,  fatigue,  drug  state,  and  the  integrity  of  the 
underlying  neural  mechanisms  (Ditchburn,  1973;  Hall,  1976;  Kim.  Xangemelster, 

6  Stark,  1984;  Krlvohlavy,  Kodat,  &  Clzek,  1969;  Monty,  Hall.  &  Rosenberger, 
1975).  Visual  activities  which  have  been  monitored  for  these  purposes  Include 
visual  evoked  brain  potentials,  eyebllnk  frequency,  pupil  diameter,  visual 
nystagmus,  pursuit  eye  movements,  percent  time  that  eyes  are  closed,  and 
saccadic  eye  movement  (e.g.,  velocity,  amplitude,  and  duration). 

Our  plan  in  what  follows  is  to  describe  the  various  visually  based 
measures  and  then  to  conduct  the  quantitative  meta-analysis  of  these  methods. 

Functional  Field  of  View.  One  visually-based  approach  to  the  assessment 
of  workload  Involves  the  measurement  of  an  observer's  functional  field  of  view 
(Sanders,  1970).  Mackworth  (1963)  has  described  the  functional  field  of  view 
as  an  area  around  central  fixation  from  which  information  is  actively 
processed  during  performance  of  a  visual  task.  The  functional  field  of  view 
has  been  found  to  be  sensitive  to  cognitive  load  in  that  it  changes  in  size 
according  to  processing  demands.  As  processing  demands  increase,  a  shrinkage 
of  the  functional  field  of  view  is  typically  observed.  Mackworth  (1963)  has 
referred  to  this  constriction  as  "tunnel  vision,"  and  has  proposed  that  it 
serves  to  prevent  an  overloading  of  the  processing  system  when  more 
information  is  available  than  can  be  processed.  Others  (Burst  1,  1958; 
Teichner.  1968)  have  also  discussed  a  shrinking  of  attentional  fields  as 
greater  processing  demands  are  Imposed.  Such  modulation  of  the  functional 
field  of  view  with  task  demands  has  been  reported  in  single  task  paradigms 
such  as  visual  search  (Edwards  &  Goolkaslan,  1974),  and  matching  (Williams  & 
Lefton,  1981),  as  well  as  in  dual  task  paradigms  wnere  attention  is  divided 
between  a  foveal  and  peripheral  task  (Acosta  6  Dlckman,  1984;  Holmes,  Cohen, 
Halth,  6  Morreson.  1977;  Williams.  1982,  1985). 

Pupil  Size.  Pupil  dilation  is  Induced  by  sympathetic  nervous  system 
activation  and,  therefore,  it  has  been  used  as  a  measure  of  'workload  because 
it  may  reflect  a  general  state  of  arousal  in  the  organism  (Bradshaw,  1968; 
Poock,  1972).  This  is  also  a  disadvantage  of  the  technique  in  that,  coupled 
with  its  major  function  of  regulating  the  amount  of  light  that  enters  the  eye, 
the  sensitivity  of  pupil  diameter  to  emotional  stress  may  limit  its  usefulness 
in  operational  situations.  However,  under  laboratory  conditions,  pupil 
dilation  has  been  very  tightly  tied  to  task  stimulus  conditions  (Beatty  1976, 
1979,  1982).  For  example,  Kahneman  and  Beatty  (1966)  showed  that,  in  a  task 
requiring  subjects  to  memorize  and  then  repeat  digit  strings,  pupil  dilation 
Increased  with  presentation  of  the  digits,  and  then  decreased  as  the  letters 
were  repeated.  In  addition,  the  magnitude  of  the  peak  was  related  to  the  size 
of  the  digit  string  to  be  memorized.  Systematic  variations  in  pupil  size  have 
also  been  associated  with  performance  changes  in  a  secondary  task  (Kahneman, 
Beatty,  &  Pollack,  1967),  rehearsal  strategies  that  improve  memory  (Kahneman, 
Onuska,  6  Wo l man  (1968),  language  processing  (Ahern  6  Beatty,  1981;  Beatty  (. 
Wagoner,  1978;  Wright  6  Kahneman,  1971),  mathematical  reasoning  (Ahern  6 
Beatty,  1979,  1981;  Bradshaw,  1968;  Hess  &  Polt,  1964;  Payne,  Parry,  6 
Harasymiw,  1968),  sensory  perception  (Hakerem  6  Sutton,  1966)  and 
discrimination  (Kahneman  6  Beatty,  1967).  Beatty  (1982)  presents  evidence 
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that  pup  1  Home  try  may  be  used  to  Index  between- task  variations  in  workload. 
Pupil  dilation  varied  as  a  function  of  loaded  flight  task  (Anderson  &  Chiou, 
1977). 


Bye  Scannlng/Dwe I 1  Times.  Harris,  Tole,  Bphrath.  &  Stephens,  (1982)  found 
that  Increases  in  dwell  times  were  associated  with  Increased  workload  during  a 
piloting  task  under  simulated  Instruments  conditions.  Other  investigators 
have  performed  eye  scan  analyses  to  measure  visual  workload  (Krebs  &  winger t, 
1977;  Simmons  &  Kimball.  1977,  1979;  Sissons,  Kimball,  &  Diaz.  1976;  Simmons 
Lees,  (■  Kimball,  1978a, b;  Simmons,  Sanders,  &  Kimball,  1979;  Waller.  1976), 
evaluate  the  usefulness  of  instruments  during  landing  (Dick  &  Bailey,  1976; 
Dick  6  Bailey,  1976;  Spady,  1978;  Waller,  Harris.  6  Sa Lairs,  1979;  Weir  6 
Klein,  1970),  and  to  evaluate  the  workload  of  displays  and  Instrument 
configurations  (Barnes,  1977;  clement,  1976;  Harris,  Tole,  Bphrath.  & 

Stephens,  1982). 

Bye  Blink  Analysis.  Stern  and  Skelly  (1984)  assessed  eyebiink,  blink 
rate,  and  blink  duration  In  two  simulated  bomber  missions.  Differing  task 
demands  were  reflected  by  blink  rate  and,  in  addition,  blink  duration  appeared 
to  be  affected  by  time  on  task.  In  other  research,  Bauer,  Goldstein,  6  Stern 
(1987)  found  that,  in  an  encoding  and  retention  task,  blink  rate  was  depressed 
following  the  presentation  of  task  cues,  memory  set,  and  test  stimulus. 

Bye  Movement  Extent.  Malmstrom  and  colleagues  (Malmstrom  6  Reed,  1983; 
Malmstrom,  Reed,  6  Randle,  1983)  reported  a  restriction  of  pursuit  eye 
movement  range  during  a  concurrent  auditory  task.  Ccder  (1977)  found  that 
frequency  of  large  amplitude  of  eye  movements  was  reduced  under  driving 
conditions  presumed  to  Induce  high  levels  of  workload.  In  addition, 
restriction  In  saccade  lenqth  was  measured  In  cats  under  conditions  of  high 
arousal  Induced  by  amphetamines  (Crommellnck  6  Roucoux,  1976).  Hall  (1976) 
who  appears  to  be  the  first  (cf.,  also  Hall  6  Cusack,  1972)  to  have  Identified 
this  phenomenon,  provides  the  clearest  explanation  of  how  this  relation  may 
reflect  a  gating  process  In  the  oculomotor  system. 

Results  of  Quant  it a  1 1  ve  Met  a  -_Ana  1  y  s  l  s 

Table  6  presents  the  results,  using  the  same  format  as  was  used  in  Table 
4.  The  Indicants  are  organized  Into  seven  categories:  narrowed  visual  field, 
pupillary  dilation,  eye  movement  extent,  eyebltnk  frequency,  fixation 
fraction,  nystagmus,  and  event  related  potentials.  At  the  t>ottom  of  the  table 
the  sample  size,  maximum  and  average  fpp  arc  given  f:':  j!1  ™ven  categories 
combined . 

The  maxlmtas  rpb  In  Table  b  (.801)  is  higher  than  for  visual  indicants  in 
Table  4  (.696).  This,  however.  Is  entirely  to  be  expected.  The  larger  a 
sample  Is  the  larger  the  largest  value  In  the  sample  Is  expected  to  be.  If 
the  larger  sample  Includes  the  scalier,  the  maximum  rpb  must  be  at  least  as 
large  In  the  larger  as  in  the  smaller  sample.  The  average  rpb  In  Table  b  Is 
somewhat  but  not  a  great  deal  larger  than  the  average  rpb  for  visual 
Indicants  In  Table  4.  Altogether,  therefore,  the  results  In  Table  b  agree 
substantially  with  those  for  visual  Indicants  In  Table  4.  Hence,  the  first 
result  of  the  survey  Is  to  confirm  the  general  position  of  visual  relative  to 
other  indicants  of  operator  Independent  workload. 
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The  second  major  result  in  Table  5  Is  the  prominent  position  of  pupillary 
dilation  and  eye-movement  extent  among  visual  indicants.  This  result  is 
especially  heartening  inasmuch  as  eye-movement  extent  is  much  the  same  as 
saccade  length.  This  implies,  but  does  not  prove,  that  in  studying  saccade 
length  as  an  indicant  of  workload  we  may  be  “barking  up  the  right  tree.* 


TABLE  5.  Effect  Size 

by  Subcategory  of 

Visual 

Indicant 

Point 

Biserial  r 

Visual  Indicant 

N 

Maximum 

Averaqe 

Narrowed  visual  field 

24 

.  569 

.275 

Pupillary  dilation 

19 

.801 

.  535 

Eye -movement  extent 

12 

.788 

.486 

Eyebllnk  frequency 

8 

.640 

.411 

Fixation  fraction 

3 

.696 

.504 

Nystagmus 

4 

.  446 

.300 

Event  related  potentials 

12 

.578 

.310 

All  indicants 

73 

.801 

.377 

Table  6  presents  effect  sl/e  for  pupillary  dilation  and  eye  movement 
extent  broken  down  by  "how  far  apart*  the  two  operator  Independent  treatment 
conditions  are.  The  left  column  contains  the  average  value  of  rpb  for  the 
lightest  contrasted  with  the  heaviest  workload  used  In  the  study  (for  example, 
light/heavy  In  a  3  condition  ( 1  Ight  moderate  heavy  design).  The  right  column 
contains  the  average  value  of  rpb  for  adjacent  levels  ( l Ight/moderate  or 
m-  .••rate/heavy  In  a  3  condition  design).  It  is  not  possible,  of  course,  to 
say  In  other  terms  how  far  apart  the  lightest  and  heaviest  conditions  really 
are,  since  there  is  no  common  metric;  but  clearly  the  high  values  in  the  left 
column  ought  not  to  be  overemphas  l  /.ed .  To  be  able  to  discriminate  between  top 
and  bottom  does  not  seem  a  sufficient  credential  for  successful  biological 
assay.  The  right  column  Is  more  to  the  point  and,  also,  more  problematic. 
Neither  pupillary  dilation  nor  eye  movement  extent,  and  they  appear  to  be  the 
best  visual  Indicants  available  (with  trie  possible  exception  of  saccade 
length),  do  an  especially  good  job  of  discriminating  between  adjacent  levels 
of  operator  Independent  workload.  The  between  group  sums  of  squares  In  these 
adjacent  level  rpb  account  for  '.ess  than  20  percent  of  the  whole.  Hence, 
while  the  outlook  for  visual  Indicants  of  workload  seems  to  be  hopeful,  much 
remains  to  be  done  by  way  of  locating  better  Indicants  and  pet  feet lng  them. 
Judglnq  from  this  survey,  however,  saccade  length  could  well  be  such  a  "better 
Indicant . " 
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TABLE  6.  Effect  size  for  Maximally  Distant  and  Adjacent  Workload 
Levels:  Pupillary  Dilation  and  Eye-Movement  Extent 


Polnt-blserlal  r 

Measure  Maximally  Distant  Adlacent 

Pupillary  dilation  .801  .354 

Eye-movement  extent  .679  .434 


LITERATURE  CATALOGUE 

The  literature  was  culled  for  work  relating  to  workload.  This  resulted  In 
the  preparation  of  a  bibliography  containing  over  600  items  (Appendix  A).  In 
addition,  to  discern  general  trends  In  the  literature,  empirical  experimental 
work  since  1970  was  catalogued  by  workload  metric  category:  that  is,  by 
whether  the  workload  metric  was  physiological,  subjective,  performance  based, 
or  vlslon/eye  movement.  Three  hundred  and  twenty  eight  papers  were  so 
characterized  and  and  are  presented  in  Tables  10  13.  In  each  table,  the 
publication  year,  workload  indice,  and  setting  for  data  collection  are  given, 
along  with  the  author (s)  and  publication.  Entries  are  listed  alphabet ical ly 
by  author.  Literature  chosen  for  the  tables  Include  studies  conducted  to 
validate  workload  metrics  and  those  in  which  the  mental  load  imposed  by  task, 
system,  or  subject  variables  is  assessed.  Unpublished  papers  and  manuscripts 
and  foreign  literature  were  not  included. 

Table  7  summarizes  the  primary  publication  areas.  It  can  be  seen  that  85 
percent  of  this  sample  of  literature  is  contained  in  eight  publication  types. 
The  primary  publication  avenues  are  technical  reports  arid  Proceedings  of  the 
Human  Factors  Society  meetings.  Less  than  74  percent  of  tills  literature  is 
published  in  referenced  Journals. 


TABLE  7.  Major  Publication  Areas  for 
Workload  Literature  (Sample  Size  7.78) 


Pub l lcat ion 


Percent  ageL 


Technical  Reports,  Contractor  Reports 
Proc.  Human  Factors  Society 
Proc.  Conf .  Manual  Corn  rol/NASA 
Unlv.  Conf.  Manual 
Human  Factors 

AGARD  Conference  Proceed ings 
Aerospace  Med./Aviat.  Space,  and 
Knv l ron .  Med . 

Ergonom i cs 
Other 


75 

77 

10 

10 

7 
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Table  8  summarizes  Che  proportion  of  the  literature  that  Includes  each  of 
the  workload  categories  for  two  tine  periods:  1970-1979  and  1980 — 1988.  The 
table  shows  that  the  proportion  of  the  literature,  including  physiological, 
performance,  and  vision/eye  movement -based  metrics,  appears  more  or  less 
stable  from  the  1970s  to  1980s.  Notable,  though,  is  the  increase  in  the 
proportion  of  studies  including  subjective  measures  of  workload. 


TABLE  8.  Percentage  of  Workload  Sample  Including 
Each  Workload  Class 


Year 

Workload  Class  1970-79  1980-88 


Physiological 

27\ 

27% 

Subjective 

33\ 

80% 

Performance 

66\ 

68% 

Eye  Movement 

17\ 

14% 

Sample  Sizes 

21S 

113 

Table  9  summarizes  the  proportion  of  experimental  effort  Including 
physiological  and  vlslon/eye  movement  based  measures.  Among  the  physiological 
Indices,  evoked  cortical  potentials  are  notable  for  the  Increased  focus  on 
them  in  the  1980s,  compared  to  the  1970s.  This  Is  perhaps  because  of  their 
potential  role  In  the  testing  of  limited  capacity  processing  models  of 
workload  and  information  processing.  Studies  which  Include  elect rocard logt am 
and  body  fluid  analysis  were  not  represented  in  the  1980s  sample  suggesting 
the  declining  Interest  in  these  measures  as  workload  metrics.  Measures  of 
heart  rate  were  well  represented  in  the  1970s  and  1980s  sample. 

Among  the  eye  movement  based  measures,  it  is  notable  that  blink  rate  was 
included  in  half  of  the  16  studies  in  the  1980  decade,  but  In  only  5%  of  the 
1970s  decade  sample.  Literature  including  eye  movement/scan/extent  measures 
appear  to  have  declined  from  the  1970s  to  1980s.  The  experimental  results  in 
this  report  suggest,  though,  that  eye  movement  extent  is  potentially  valuable 
in  the  assessment  of  mental  workload.  In  addition,  preliminary  evidence  is 
that  blink  rate  and  eye  movement  extent  are  independent,  suggesting  that 
future  research  should  Include  both  in  the  assessment  of  workload.  Finally, 
Tables  10-13  summarize  the  majority  of  the  experimental  work  done  since  1970, 
organized  by  type  of  workload  metric,  author(s),  date,  and  publication. 


21 


TABLE  9.  Preparation  of  Workload  Sample  Including 
Major  Physiological  and  Vision/Eye  Movement  Measures 


year 


1970-79 

1980-88 

Physiological 

Heart  Rate 

65\ 

53\ 

Electrocardiogram 

33\ 

0 

Blood  Pressure 

5\ 

3\ 

Electromyogram 

12\ 

3\ 

Respiration  Rate 

26\ 

17\ 

Skin  Resistance 

16\ 

7\ 

Body  Fluid  Analysis 

22\ 

0 

Evoked  Cortical  Potentials  10\ 

53\ 

Vlslon/Eye  Movements 

Blink  Kate 

b\ 

S0\ 

Pupil  Dilation 

25\ 

3  1\ 

Eye  Movement/Scan/Kxtent 

S3\ 

19\ 

Field  of  Vl«?w 

3\ 

19\ 

Sample  Sizes 

40 

16 

n. 


TABLE  10.  Physiological  Indicants 


Year 

Haasure 

Setting 

Authors 

Publication 

1987 

HR 

Lab 

Aasman  et  al. 

Human  Factors 

1988 

BP.  BCP. 
EMC, HR 

Lab 

Albery  et  al. 

Proc.  Human  Factors  Society 

1984 

HR 

Lab 

Antin  &  Wierwille 

Proc.  Human  Factors  Society 

1987 

BCP 

HR 

Bauer  et  al. 

Human  Pactors 

1979 

SR 

Lab 

Benel  et  al. 

Proc.  Human  Factors  Society 

1985 

BCP 

Lab 

Blferno 

Report 

1974 

BP. HR 

Plight 

Blyx  et  al. 

Aerospace  Medicine 

1974 

BOG. HR. 

Lab 

Boyce 

Ergonomics 

1974 

BP 

Pi ight 

Brictson  et  al. 

AGARD  Conference  Proceedings 

1979 

HR.  SR 

Sim 

Buckley  &  O’Connor 

AGARD  Conference  Proceedings 

1975 

HR 

Field 

Cap lan  &  Jones 

J.  Applied  Psychology 

1983 

HR.  RR 

Sim 

Casali  &  Wierwille 

Human  Factors 

1984 

HR.  RK 

Sim 

Casall  &  Wierwille 

Ergonomics 

1977 

BP.  HR 

Flight 

Clark  6  Armstrong 

Report 

1971 

BP.  HR 

RR 

Lab 

Kttema  &  7,ielhuis 

Ergonomics 

1976 

BP.  HR 

Lab 

Frankenhaouser  6 
Johansson 

J.  Human  Stress 

1977 

EEC 

Lab 

Gale  et  al . 

Ergonomics 

1975 

BP.RR.SR 

Lab 

Gaume  6  White 

Repoi t 

1983 

KCP 

Lab 

Gill  6  Wickens 

Proc.  Conf.  Manual  Conttol 

1984 

kc:p 

Lab 

Gopher 

Proc.  Conf.  Manual  Control 

'  )82 

MK.KK 

PI  i  :ht 

Graaf f 

Proc.  Flight  Test  Workshop 

1971 

HP 

PI Ight 

Hale  et  a  l  . 

Aerospace  Medicine 

1984 

MR 

PI Ight 

Hart  et  al. 

Proc.  Human  Factors  Society 

1975 

HR 

P  i  e  1  <1 

lie  lander 

Repor t 

197? 

HR 

Lab 

Hicks  6  Sol iday 

Proc.  Human  Factors  Society 

1979 

HR 

Sim 

H icks  6  W lerwi l le 

Human  Factors 

1984 

KCP 

Lab 

Horst  et  al . 

Proc.  Human  Factors  Society 

1978 

KEG , KOG 

P 1 i gh t 

How  1 1 1  e  t  a  1  . 

Avlat.  Space  &  Env .  Med. 

1977 

HR 

Lab 

1  noma  t  a 

J.  Human  Ergology 

1980  1 

KCP 

Lab 

1 srea  l  et  a  l  . 

Psychophys loloqy 

1980  l 

KCP 

Lab 

1 srra 1  et  a  1  . 

Human  Factors 

1979 

KCP 

Lab 

Isrea  1  et  a  l . 

Proc.  Human  Factors  Society 

197? 

HR 

Lab 

Jenney  et  a  1 . 

Repor  t 

1970 

KOG.EKG. 
HR . RR , SR 

Lab 

Jex  &  Allen 

Proc.  NASA  Conf.  Manual  Ctrl 

1977 

BP 

Plight 

krahenbuhl  et  al. 

Report 

1985 

KCP 

Lab 

Kramer  6  Wickens 

Proc.  Human  Factors  Society 

1987 

BCP 

Sim 

Kramer  et  al. 

Human  Factors 

1983 

BCP 

Lab 

Kramer  et  al . 

Hunan  Factors 

1988 

BCP 

Lab 

Laiehzar lan 

Proc.  Human  Factors  society 

1988 

HR 

Pi ight 

Linde  &  Shively 

Proc.  Human  Factors  Society 

23 


1981 

ECP, HR, SR 

Sim 

Llndholm  et  al. 

Report 

1984 

ECP. HR, SR 

Sim 

Lind holm  et  al. 

Report 

1976 

E8G.HR, SR 

Lab 

Lorens  &  Da r row 

Elect roenceph.  &  Clin. 

1974 

BP 

Plight 

McHugh  et  al. 

AGARD  Conference  Proceedings 

1979 

HR,  SR 

Sim 

McKenzie  et  al. 

AGARD  Conference  Proceedings 

1979 

BP 

Pie  Id 

Melton 

AGARD  Conference  Proceedings 

1976 

BP,  HR 

Pleld 

Melton  et  al. 

Avlat.,  Space  &  Bnv.  Med. 

1977 

BP, BOG 

Field 

Melton  et  al. 

Report 

1970 

BP, HR 

Plight 

Miller  t  Rubin 

Report 

1971 

BOG ,  HR ,  RR 

Lab 

Hobbs  et  al. 

Report 

1973 

BOG , HR , RR 

Lab 

Mulder  t  van  der 
Meulen 

Ergonomics 

1988 

ECP 

Lab 

Nataupsky  et  al. 

Proc.  Hunan  Factors  Society 

1973 

BOG, NT 

Plight 

Nicholson  et  al. 

Aerospace  Medicine 

1979 

ECG.EMG 

HR 

Sim 

North  &  Graffunder 

Proc.  Hunan  Factors  Society 

1973 

HR.RR 

Sim 

Opmeer  &  Krol 

Aerospace  Medicine 

1985 

ECP 

Lab 

Parasuraman 

Proc.  Human  Factors  Society 

1977a 

RK 

Plight 

Pettyjohn  et  al. 

AGARD  Conference  Proceedings 

1977b 

RR 

Plight 

Pettyjohn  et  al. 

Report 

1982 

RK 

Sim 

Rahimi  &  Wlerwille 

IEEE  Conf.  Cyber.  £>  Society 

1976 

ECG.EMG 

HR.RR 

Plight . 
Sim 

Rault 

Book 

1984 

HR 

Lab 

Robertson 

Proc.  Human  Factors  Society 

1985 

HR 

Lab 

Robertson  6  Moshkate 

Proc.  Human  Factors  Society 

1978 

HR 

Plight 

Roscoe 

Avlat.,  Space  6  Env.  Med. 

1976 

HR 

Plight 

Roscoe 

Avlat.,  Space  6  Env.  Med. 

1975 

HR 

Plight 

Roscoe 

Avlat..  Space  &  Env.  Med. 

1973 

HR 

Sim 

Roscoe  6  Goodman 

Repot  t 

1973 

HR.RR 

Field. 

Lab 

Sayers 

Ergonomics 

1978 

HR 

Lab, Sim 

Sek  *  ,uch i  et  a  1 . 

Avlat.,  Space  6  Env.  Med. 

1987 

HR 

Plight 

Shively  et  al 

Proc.  Symp.  Avlat.  Psychology 

1975 

HCG.HK 

Lab 

Simonov  et  al. 

Avlat.,  Space  6  Env.  Med. 

1979 

HR 

Sim 

Sm  1 1  h 

kepor  t 

1977 

ECO . ECP , 
HR 

Sim 

Soede 

Proc.  NASA  Conf.  Manual  Ctrl. 

1977 

BE. ECO. 

ECP 

Lab 

Sou tend am 

AGARD  Conference  Proceedings 

1971 

ECO .  EEC 
EMG. HR.RR 

SR 

ECO. HR 

Lab 

Spyker  et  al. 

Repot t 

1973 

PI  ight . 
Sira 

Stackhouse 

Repot  t 

1976 

ECG.EMG 

RR 

Sim 

Stackhouse 

Kepor  t 

1976 

BP 

Plight 

Storm  et  al . 

Report 

1977 

HR 

Lab 

Strasser 

AGARD  Conference  Proceedings 

1973 

ECP,  1IR 

Lab 

Strasser  et  al. 

Aerospace  Medicine 

1970 

BP 

Lab 

Street  at  al. 

Human  Factors 

1976 

ECG.EMG 

RR 

Sim 

Sun  et  al. 

Proc.  Aviat.  Electronics 

Symp. 

1987 

HR 

Lab 

Vicente  et  al. . 

Human  Factors 

1975 

BOG, HR, 
RR,SR 

Lab 

White  &  G a urne 

Report 

1977 

acp 

Lab 

Wlckens  et  al. 

Proc.  Human  Factors  Society 

1976 

BCP 

Lab 

Wlckens  et  al. 

Proc.  NASA  Conf.  Manual  Ctrl 

1983 

HR.RR 

Sim 

Wlervllle  &  Connor 

Human  Factors 

1978 

ECO, EMC 
HR.RR 

Sim 

Wolfe 

Report 

1979 

BCG, ENG 
HR, SR 

Pie  Id 

Zeier 

Ergonomics 

BF  3  Body  Fluid  Analysis,  BP  3  Blood  Pressure.  BCP  3  Evoked  cortical 
Potentials,  BCG  3  Electrocardiogram.  EBG  »  Electroencephalogram,  ENG  = 

Elect romyogram,  HR  *  Heart  Rate,  MT  3  Muscle  Tension,  RR  *  Respiration  Rate, 
SR  3  Skin  Resistance 


TABLE  11.  subjective  Measures 


Year 

Authors 

Publication 

1903 

R 

Lab 

Acton  et  al. 

Proc.  Human  Factors  Society 

1984 

R 

Lab 

Albery  et  al. 

Proc.  Hunan  Factors  Society 

1970 

I/O 

Sin 

Anderson  &  Tolvanen 

Report 

1984 

I/O 

Lab 

Ant  in  &  Wierwille 

Proc.  Hunan  Factors  Society 

1979 

R 

Sim 

Bateman 

Proc.  Hunan  Factors  Society 

1984 

I/O.* 

Ambig. 

Bateman  et  al. 

Proc.  Hunan  Factors  Society 

1988 

R 

Sim 

Battlste  &  Bortolussl 

Proc.  Hunan  Factors  Society 

1985 

R 

Lab 

Battiste  &  Hart 

Proc.  Symp.  Avlat.  Psychology 

1984 

R 

Sim 

Berg  6  Sheridan 

Proc.  Conf.  Manual  Control 

1985 

R 

Sira 

Berg  &  Sheridan 

Report 

1986 

R 

Sira 

Berg  &  Sheridan 

Proc.  Conf.  Manual  Control 

1988 

R 

Lab 

Biers  et  al. 

Proc.  Human  Pactors  Society 

1985 

R 

Lab 

Blferno 

Report 

1985 

R 

Lab 

Bloem  6  Damos 

Psychological  Reports 

1985 

R 

Sim 

Bortolussl  et  al. 

Proc.  Symp.  Aviat.  Psychology 

1987 

R 

Sira 

Bortolussl  et  al. 

Proc.  Symp.  Avlat.  Psychology 

1983 

R 

Lab 

Boyd 

Proc.  Human  Factors  Society 

1976 

l/Q 

Sim 

Hromberger 

Report 

1988 

R 

Field 

Byers  et  al. 

Proc.  Human  Factors  Society 

1983 

R 

Sira 

Casall  &  Wierwille 

Human  Factors 

1984 

R 

Sira 

Casal l  &  Wlerwl l le 

Ergonomics 

1975 

H 

Field 

Cap lan  6  Jones 

Journal  of  Applied  Psychology 

1982 

R 

Sim 

Childress  et  al. 

Proc.  Human  Factors  Society 

1977 

l/Q 

K1 ight 

Clark  6  Armstrong 

Report 

1976 

R 

Sim 

Clement 

Proc.  NASA  Conf.  Manual  Ctrl. 

1983 

I/O 

Sim 

Connor  &  Wierwille 

Report 

1974 

I/O 

Sim 

Cork Indalo 

AGARD  Conference  Proceedings 

1984 

R 

Field 

Court  right  6  Kuperman 

HFSC 

1975 

R 

Sim 

Crabt  ree 

Report 

1984 

K 

Lab 

Crabt  ree  et  al . 

Proc.  Human  Factors  Society 

1984a 

R 

l.ab 

Damos 

Proc.  Conf.  Manual  Control 

1984b 

R 

Lab 

Damos 

Eng.  Tech.  Conf.  Proc. 

1984c 

7 

7 

Damos 

Repor t 

1984d 

R 

Lab 

Damos 

Perceptual  and  Motor  Skills 

1985 

R 

Lab 

Damos 

Human  Factors 

1988 

R 

Lab 

Deaton  6 

Proc.  Human  Pactors  Society 

Parasuraman 

1981 

R 

Lab 

Derrick 

Proc.  Human  Factors  Society 

1983 

R 

Lab 

Derrick 

Proc.  Human  Factors  Society 

1976 

1/0 

Sim 

Dick  6  Bailey 

Report 

1976 

R 

Sira 

Dick  et  al. 

Report 

1983 

R 

t.ab 

Eckel  6  Crabtree 

Proc.  Symp.  Avlat.  Psychology 

1984 

R 

Lab 

Eggemeler  6  Quinn 

Proc.  Human  Factors  Society 

1984 

R 

1  wib 

Eggeraeler  6  Stadler 

Proc.  Human  Pactors  Society 

1983 

R 

Lab 

Eggemeler  et  al. 

Proc.  Human  Factors  Society 

26 


1982 

R 

Lab 

Eggmelar  at  al. 

Proc.  Human  Factors  Society 

1964 

R 

Lab 

Bggaaeler  et  al. 

Proc.  Human  Factors  Society 

1977 

R 

Lab 

Fargenson  &  Gold 

Proc.  Human  Factors  Society 

1977 

I/O 

Flight 

Galsalhart  at  al. 

Report 

1976 

I/O 

Flight 

Galsalhart  et  al. 

Report 

1977* 

R 

Lab 

Goerres 

AGARD  Conference  Proceedings 

1977b 

R 

Lab 

Goerres 

Avlat.,  Space,  &  Env.  Ned. 

1984 

R 

Lab 

Gopher 

Proc.  Conf.  Manual  Control 

1984 

R 

Lab 

Gopher  &  Braune 

Human  Factors 

1965* 

R 

Lab 

Gopher  at  al. 

Report 

1985b 

? 

Lab 

Gopher  at  al. 

Proc.  Human  Pactors  Society 

1982 

R 

Flight 

Graaff,  R.  C.  van  de 

Proc.  Plight  Test  Workshop 

1978 

R 

Sim 

Gunning 

Proc.  Human  Factors  Society 

1978 

l/o. R 

Flight 

Hagen  et  al. 

Report 

1988 

K 

Lab 

Hancock  et  al. 

Proc.  Human  Factors  Society 

1982 

K 

Sim 

Harris  et  al. 

Proc.  Human  Factors  Society 

1984 

1/0 

Lab 

Hart  &  Bortolussl 

Human  Factors 

1983 

K 

Sim 

Hart  &  Chappell 

Proc.  Conf  Manual  Control 

1977 

R 

Sim 

Hart  et  al. 

Report 

1981 

R 

Lab 

Hart  et  al. 

Proc.  Human  Factors  Society 

1982 

K 

Lab 

Hart  et  al. 

Proc.  Eighth  Psy.  In  the  DoD 
Symp . 

1984a 

K 

Lab 

Hart  et  al. 

Proc.  conf .  Manual  Control 

1984b 

K 

Fl ight 

Hart  et  al. 

Proc.  Human  Factors  Society 

1984c 

K 

Lab 

Hart  et  al. 

Proc.  Human  Factors  Society 

1983a 

K 

Lab 

Hauser  6  Hart 

Proc.  Human  Factors  Society 

1983b 

K 

Lab 

Hauser  6  Hart 

Proc.  Conf.  Manual  Control 

1983 

K 

Lab 

Hauser  et  al. 

Proc.  Conf.  Manual  Control 

1986 

K 

Sim 

Haworth  et  al . 

Proc.  American  Helicopter 

Soc i et y 

1975 

K 

Kl Ight 

Helm 

Repot t 

1976  b 

K 

Flight 

Helm 

Repor  t 

1979 

H 

Sira 

Hicks  6  Wlerwllle 

Human  Factors 

1988 

It 

Field 

Hill  et  al. 

Proc.  Human  Factors  Society 

1978 

1/0 

Flight 

Howl 1 1  et  al 

» v i a t .  Space  6  Knv.  Med. 

1978a 

R 

Field 

Hurst  &  Rose 

Kr  gonom les 

1987b 

R 

Field 

Hurst  6  Rose 

Ergonomics 

1972 

K 

Lab 

Jenney  et  al. 

Repor  t 

1976 

K 

S  im 

Johannsen  et  al. 

Hook 

1976 

K 

Sira 

Johnston  et  al . 

Rej>o;  t 

1981 

K 

Sim 

Kantowltz  et  al . 

Proc.  Human  Factors  Society 

1984 

R 

Sim 

Kantowltz  et  al. 

Proc.  Corit  .  Manual  Control 

1979 

K 

S  i  ra 

Kopala 

Proc.  Human  Factors  Society 

1972 

H 

Sira 

Kornstadt  & 
Pfennlgstorf 

AfJARL)  Conference  Proceedings 

1977 

K 

Field 

Koym 

Repor  t 

1987 

K 

Sira 

Kramer  et  al. 

Human  Factors 

1976 

K 

Sim 

Krebs  6  Wingert 

Report 

1977 

K 

Sim 

Krebs  et  al. 

Repor t 

1976 

K 

Sim 

Kreifeldt  et  al. 

Proc.  NASA  Conf.  Manual  Ctrl 

1972 

7 

7 

Krzanowskl 

Aerospace  Medicine 

1976 

K 

Field 

Kuhar  et  al. 

Ref>ort 

27 


1975 

R 

Flight 

Lebacqz  &  Aiken 

Report 

1988 

R 

Flight 

Linde  &  Shively 

Proc.  Hunan  Factors  Society 

1979 

R.I/0 

Sim 

Madero  et  al. 

Report 

1977 

l/Q 

Flight 

Markelwicz  et  al. 

Report 

1976 

R 

Field 

Melton  et  al. 

Avlat.  Space  &  Env.  Med. 

1977 

R 

Field 

Melton  et  al. 

Report 

1984 

R 

Lab 

Miller  &  Hart 

Proc.  Conf .  Manual  Control 

1986 

R 

Lab 

Miller  et  al. 

Aerospace  Behav.  Eng.  Tech. 

1977 

R 

Lab, Sim  Milord  &  Perry 

J.  General  Psychology  Conf. 

1974 

l/Q 

Sim 

Murphy  et  al. 

Proc.  NASA  Conf.  Manual  Ctrl. 

1970 

I/O 

Flight 

Murrell  et  al. 

AGARD  Conference  Proceedings 

1988 

R 

Lab 

Nataupsky 

Proc.  Human  Pactors  Society 

1973 

I/O 

Flight 

Nicholson 

Aeronautical  Journal 

1979 

R 

Sim 

North  &  Graf funder 

Proc.  Human  Pactors  Society 

1984 

R  ' 

Lab 

Notest ine 

Proc.  Human  Factors  Society 

1973 

R 

Sim 

Opmeer  &  Krol 

Aerospace  Medicine 

1971 

R 

Field 

Philipp  et  al. 

Ergonomics 

1982 

I/O 

Sim 

RatUmi  &  Vierwllle 

IEEE  Conf.  Cyber.  6  Society 

1976 

R 

Field. 

Sim 

Rault 

Book 

1983 

R 

Lab/Slm 

Rehraann  et  al. 

Human  Factors 

1981 

R 

Lab 

Reid  et  al. 

Proc.  Human  Factors  Society 

1976 

R 

Sim 

Repa  &  Wlerwi l le 

SAE  Paper 

1982 

K 

Lab 

Repperqer  et  al. 

Report 

1985 

R 

Lab 

Revesman  6  Rokicki 

Proc.  Human  Factors  Society 

1984 

R 

Lab 

Robertson 

Proc.  Human  Factors  Society 

1985 

R 

Lab 

Robertson  6  Meshkat i 

Proc.  Human  Factors  Society 

1974 

R 

Sim 

Rolfe  et  al. 

AGARD  Conference  Proceedings 

1982 

R 

Lab 

Rosenberg  et  al. 

Report 

1975 

R 

Flight 

Roscoe 

Avlat.,  Space  &  Env.  Med. 

1976 

R 

Flight 

Ro-.COC 

Avlat.,  Space  &  Env.  Med. 

1978 

R 

P 1 ight 

fi  •'  lers  et  al. 

Report 

1980 

K 

FI  ight 

Sch  i  f  lei  t 

Report 

1985 

R 

Lab 

Schlcgel 
ft  Shlngledecket 

Proc.  Human  Factors  Society 

1970 

R 

Sim 

Schu 1 1  z  et  a  1 . 

Proc.  NASA  Conf.  Manual  Ctrl. 

1972 

R.  l/Q 

Lab 

Seifert  et  al. 

AGARD  Conference  Proceedings 

1987 

R 

Flight 

Sh Ively  et  a  1 . 

Proc.  Symp.  Avlat.  Psychology 

1984 

R 

Lab 

Si  lverstein  et  al . 

Repoi t 

1978 

R 

Fl  ight 

Simmons  6  Kimball 

Kepor  t 

1977 

I/O 

Lab 

Sou tend am 

AGARD  Conference  Proceedings 

1978 

R 

Sim 

Spady 

Repoi t 

1971 

K 

Lab 

Spyker  et  al. 

Report 

1973 

R 

Flight, 

Sim 

Stackhouse 

Repor  t 

1976 

R 

Lah 

Stamford 

Ergonomics 

1985 

R 

Lab 

Staveland  et  al . 

Proc.  Conf.  Manual  Control 

1977 

R/l/Q 

Plight 

Steininger 

AGARD  Conference  Proceedings 

1979 

R 

Flight 

Stone  et  al. 

Repor  t 

1978 

l/Q 

Sim 

St  relb 

Report 

1976 

K 

Flight 

Strom  et  al. 

Report 

1987 

R 

Lab 

Vicente  et  al. 

Human  Factors 

28 


1988 

R 

Sim 

Vldullch  &  Bortolussl  Proc. 

Human  Factors  Society 

1985 

R 

Lab 

Vldullch  &  wickens 

Proc. 

Human  Factors  Society 

1983 

R 

Lab 

Vldullch  &  wickens 

Report 

1984 

R 

Lab 

Vldullch  &  Wickens 

Proc. 

Conf .  Manual  Control 

1985 

R 

Lab 

Vldullch  &  Wickens 

Proc. 

symp.  Aviat.  Psychology 

1976 

R 

Sim 

Waller 

Report 

1976 

R 

Lab 

Wewer Inkle 

Proc. 

NASA  Conf.  Manual  Ctrl. 

1977 

R 

Plight 

Wewerlnkle 

Proc. 

NASA  Conf.  Manual  Ctrl. 

1974 

R 

Sim 

Wewer inkle  &  Srait 

AGARD  Conference  Proceedings 

1975 

R 

Lab 

White  &  Gaume 

Report 

1983 

R 

Lab 

wickens  &  Yeh 

Proc. 

Human  Factors  Society 

1988 

R 

Sin 

Wickens  et  al. 

Proc. 

Human  Factors  Society 

1983 

R 

Sim 

Wlerwllle  6  Connor 

Human 

Factors 

1985 

R 

Sim 

Wierwille  et  al. 

Human 

Factors 

1984 

R 

Lab 

Wlerwllle  et  al. 

Proc . 

Conf.  Manual  control 

1978 

R 

Sim 

Wolfe 

Report 

1984 

R 

Lab 

Yeh  6  Wickens 

Proc . 

Human  Factors  Society 

1985 

R 

Lab 

Yeh  et  al. 

Proc . 

Human  Factors  Society 

l/Q  = 

Interviews 

and  Questionnaires,  R  3  Rating 

Scales, 

Ranking 

* 


TABLE  12.  Performance  Measures 


Year 

Authors 

Publication 

1987 

P 

Lab 

Aasraan  et  al. 

Human  Factors 

1988 

P.S 

Lab 

Albery 

Proc.  Human  Factors  Society 

1971 

P.S 

Lab 

Alluisl  &  Morgan 

Perceptual  &  Motor  Skills 

1970 

P.S 

Sim 

Anderson  &  Tolvanen 

Report 

1984 

P.S 

Lab 

Antln  &  Wierwllle 

Proc.  Human  Factors  Society 

1981 

P 

Field 

Asiala  et  al. 

Report 

1984 

P.S 

Arabig. 

Bateman  et  al. 

Proc.  Human  Factors  Society 

1988 

P 

Sim 

Battiste  & 

Proc.  Human  Factors  Society 

Bortolussi 

1985 

P 

Lab 

Battiste  &  Hart 

Proc.  Symp.  Aviat.  Psychology 

1978 

P.S 

Lab 

Bell 

Human  Factors 

1984 

P 

Lab 

Bel lenkes 

Report 

1979 

S 

Lab 

Benel  et  al. 

Proc.  Human  Factors  Society 

1979 

P.S 

S  im 

Ber inger 

Proc.  Human  Factors  Society 

1984 

P 

Sim 

Berq  &  Sheridan 

Proc.  Conf.  Manual  Control 

1985 

P 

S  im 

Berq  &  Sheridan 

Report 

1986 

P 

Sim 

Berq  &  Sheridan 

Proc.  Conf.  Manua 1  Control 

1979 

P.S 

S'  im 

Bermudez  et  al. 

Proc.  Human  Factors  Society 

1988 

P 

Lab 

Biers  et  al . 

PHFC 

1985 

P 

Lab 

Hi ferno 

Repor  t 

1985 

P,S 

Lab 

Bloera  6  Damos 

Psychological  Reports 

1985 

P.S 

Sim 

Bortolussi  et  al. 

Proc.  Symp.  Aviat.  Psychology 

1987 

P.S 

Sim 

Bortolussi  et  al. 

AP 

i  ‘*83 

P 

Lab 

Braune  &  Wlckens 

Proc.  Human  Factors  Society 

'  (74 

P 

FI  I'jbt 

Hr ictson 

AGARD  Conference  Proceedings 

1976 

P 

Sim 

Hr  timber  qer 

Report 

1979 

P 

S  im 

Buck  ley  6  O'Connor 

AGARD  Conference  Proceedings 

1979 

P.S 

Lab 

Burke 

Repor  t 

1983 

P.S 

S  im 

Casalt  6  Wierwllle 

Human  Factors 

1984 

P.S 

Sim 

Casall  6  Wierwllle 

Ergoi  tomics 

1983 

p 

Lab 

Chech  lie  &  Sadosk l 

Human  Factors 

1979 

P.S 

Lab 

Chiles  et  al. 

Aviat.,  Space  6  Kriv .  Med . 

1982 

p 

Sim 

Childress  et  al. 

Proc.  Human  Factcts  Society 

1977 

p 

FI  iqht 

Clark  6  Armstrong 

Repor  t 

1976 

P.S 

S  im 

Clement 

Proc.  NASA  Conf.  Manual  Ctrl. 

*1983 

p.? 

Sim 

Connor  6  Wierwllle 

Repot t 

1985 

p 

Fl Iqht 

Cote  et  al. 

Aviat.,  Spate,  and  Env . 

Medicine 

1975 

p 

Sira 

Ct  abt  roe 

Repor  t 

1984 

P.S 

Lab 

Crabt ree  et  al . 

Proc.  Human  Factors  Society 

1972 

p 

Sim 

Cross  6  Cavallero 

AGARD  Conference  Proceedings 

1978 

s 

Lab 

Damos 

Human  Factors 

1984a 

p 

(.ab 

Damos 

Proc.  Conf.  Manual  Control 

1984b 

p 

Lab 

Damos 

Eng.  Tech.  Conf.  Proc. 

1984c 

p 

Lab 

Damos 

Report 

30 


1984d 

P 

Lab 

Damos 

Perceptual  and  Motor  Skills 

1985 

P? 

Lab 

Damos 

Human  Factors 

1980 

P 

Lab 

Damos  &  Llntern 

Proc.  Human  Pactors  Society 

1970 

P 

Sim 

Daniels 

AGARD  Conference  Proceedings 

1988 

P 

Lab 

Deaton 

&  Parasuraman 

Proc.  Human  Pactors  Society 

1981 

P 

Lab 

Derrick 

Proc.  Human  Pactors  Society 

1983 

P.S 

Lab 

Derrick 

Proc.  Human  Pactors  Society 

1964 

P.S 

Lab 

Derrick  &  McCloy 

Proc.  Human  Pactors  Society 

1976 

P 

Sim 

Dick  et  al. 

Report 

1977 

P 

Sin 

Drennen  et  al. 

Report 

1976 

P.S 

Sim 

Dunn  et  al. 

Proc.  NASA  Conf.  Manual  Ctrl 

1978 

P 

Sim 

Edwards  et  al. 

Report 

1982 

P 

Lab 

Eggemeler  et  al. 

Proc.  Human  Pactors  Society 

1984 

P 

Lab 

Eggeitfeler  &  Stadler 

Proc.  Human  Factors  Society 

1977 

P 

Sim 

Ephrath  &  Curry 

IEEE  Trans.  Sys.,  Man.  6 
Cybernet ics 

1971 

P 

Lab 

Ettema  &  Zlelhuls 

Ergonomics 

1977 

S 

Plight 

Gelselhart  et  al. 

Report 

1976 

S 

Plight 

Gelselhart  et  al. 

Report 

1976 

P 

Lab, Sim 

Gerathewohi 

AGAKL)  Conference  Proceedings 

1978 

P.S 

Lab 

Gilson  et  al. 

Proc.  Human  Factors  Society 

1985 

P.S 

Lab 

Goet  1 1 

Proc.  Human  Factors  Society 

1978 

P.S 

Lab 

Goldstein  et  al . 

Human  Factors 

1979 

P.S 

Lab 

Gopher  6  Navon 

Proc .  Conf.  Manual  Control 

1977 

P.S 

Lab 

Gopher  et  al. 

Proc.  Human  Factors  Society 

1977 

P.S 

Lab 

Gopher  6  North 

Human  Factors 

1984 

p 

Lab 

Gopher 

Proc.  Conf.  Manual  Control 

1977 

P.S 

Lab 

Gopher  et  al . 

Kepor t 

1985a 

P.S 

Lab 

Gopher  et  al. 

Kept  . 

1985b 

p 

Lab 

Gopher  et  al . 

Pro*:.  Human  Factors  Society 

1982 

p 

Plight 

Graaff,  R.  C.  van  de 

It  t st  wrkshop 

1977 

P.S 

Lab, Sim 

Green  6  Flux 

AGARD  Conference  Proceedings 

1978 

P.S 

Sim 

Gunning 

Proc.  Human  Factors  Society 

1980 

P.S 

PI Ight 

Gunning  &  Manning 

Proc.  Human  Factors  Society 

1978 

p 

PI Ight 

Hagen  et  al. 

Repot  t 

1988 

p 

Lab 

Hancock  et  al. 

Proc.  Human  Factors  Society 

1975 

s 

i.ab 

Hart 

Proc.  Coni.  Manual  Control 

1977 

P.S 

Sim 

Hart  et  al . 

Repot t 

1976 

s 

Lab 

Hart  6  Simpson 

Proc .  NASA  Conf.  Manual  Ctrl 

1984a 

p 

Plight 

Hart  et  al . 

Proc.  Human  Factors  Society 

1986 

p 

I.ab 

Hart  et  al. 

Proc.  Conf.  Manual  Control 

1983 

p 

Lab 

Hauser  et  al. 

Pri>c.  Conf.  Manual  Control 

1978 

s 

Sim 

Hart  et  al. 

Proc.  Conf.  Manual  Control 

1983a 

p 

InSb 

Hauser  6  Hart 

Prrx:.  Human  Factors  Society 

1983b 

p 

Lab 

Hauser  6  Hart 

Proc.  Conf.  Manual  Control 

1974 

P.S 

Lab 

Hess  &  Telchgraber 

IEEE  Trans.  Sys.,  Man,  & 
Cybernet les 

1979 

P.S 

Sim 

Hicks  &  Wlerwt l le 

Human  Factors 

1988 

p 

Field 

Hill  et  al. 

Proc.  Human  Factors  Society 

1972 

p 

I.ab 

Holland  &  Tar  low 

Psychological  Reports 

1974 

P.S 

Lab 

Huddleston 

Perceptual  6  Motor  Skills 

1971 

P.S 

l.ab 

Huddleston  6  Wilson 

Ergonomics 

11 


1978a 

P 

Field 

Hurst  &  Rose 

Ergonomics 

1978b 

P 

Field 

Hurst  &  Rose 

Ergonomics 

1979 

P,S 

Lab 

Isreal  et  al. 

Proc.  Human  Factors  Society 

1972 

P.S 

Lab 

Jenney  et  al. 

Report 

1972 

P.S 

Lab 

Jex  et  al. 

Proc.  Conf.  Manual  Control 

1976 

S 

Sim 

Johannsen  et  al. 

Book 

1976 

P 

Sira 

Johnston  et  al. 

Report 

1977 

P.S 

Lab 

Kantowltz  &  Knight 

Book 

1984 

P.S 

Sim 

Kantowitz  et  al. 

Proc.  Conf.  Manual  Control 

1972 

P.S 

Lab 

Klein  &  Cassidy 

Proc.  Human  Factors  Society 

1979 

p 

Sim 

Kopala 

Proc.  Human  Factors  Society 

1972 

P.S 

Sim 

Korns t ad t 

6  Pfennlgstorf 

AGARD  Conference  Proceedings 

1987 

P.S 

Sira 

Kramer  et  al. 

Human  Factors 

1972 

P.S 

Sim 

Krause  &  Roscoe 

Proc.  Human  Factors  society 

1976 

p 

Sira 

Krebs  &  vlngert 

Report 

1977 

p 

Sim 

Krebs  et  al. 

1977 

1976 

p 

Sim 

Kreifeldt  et  al. 

Proc.  NASA  Conf.  Manual  Ctrl 

1971 

P.S 

Flight 

Krol 

Ergonomics 

1978 

P.S 

Field 

Laurel 1  6  Lispar 

Ergonomics 

1975 

p 

Flight 

Lebacqz  6  Aiken 

Report 

1988 

p 

Flight 

Linde  &  Shively 

Proc.  Human  Factors  Society 

1977 

p 

FI Ight 

Lovesay 

AGARD  Conference  Proceedings 

1979 

P.S 

S  Im 

Madero  et  a  1 . 

Repor  t 

1975 

P.S 

Fie  Id 

McDonald  i  Ellis 

Proc.  Human  Factors  Society 

1979 

p 

Sim 

McKenzie  et  al. 

AGAKD  Conference  Proceedings 

1975 

p 

Field 

McLean  6  Hoffman 

Human  Factors 

i97g 

p 

Field 

Melton 

AGAKD  Conference  Proceedings 

1977 

P.S 

Lab. Sim 

Milord  6  Perry 

J.  General  Psychology 

1984 

p 

Lab 

Miller  Si  Hart 

Proc.  Conf.  Manual  Control 

1986 

p 

Lab 

Mi  1  U r  et  a  1 . 

Aerospace  Behav .  Eng.  Tech. 
Conf  . 

1971 

s 

Fl ight 

Nagaraja  Kao  6 
Griffin 

Kepor  t 

1979 

P.S 

Sim 

Nat aupsky  et  a l . 

Proc.  Human  Factors  Society 

1977 

s 

Lab 

Nor  t  h 

Repot  t 

1976 

P.S 

i.ab 

North  6  Gopher 

Human  Factors 

1979 

p 

S  im 

North  ft  Graf  funder 

Proc.  Human  Factors  Society 

1984 

p 

Lab 

Notest i ne 

Proc.  Human  Factors  Society 

1976 

P.S 

Sim 

0 ' Donne  1 l 

AGARD  Conference  Proceedings 

1976 

p 

Sim 

Onstol r 

Proc.  NASA  Conf.  Manual  Ctrl 

1977 

P.S 

Sim 

Onstott  6  Faulkner 

Proc.  NASA  Conf.  Manual  Ctrl 

1978 

P.S 

Lab 

Owens  6  Harris 

Repor  t 

1979 

P.S 

Lab 

Payne  6  Buck 

Proc.  Human  Far.  t  or  •  Soc  i e  t  y 

1976 

s 

Lab 

Phillips 

Repor  t 

1975 

P.S 

Lab 

Pr  Ice 

Human  Factors 

1982 

p 

Sim 

Kahlml  6  Vlerwille 

IEEE  Conf.  Cyber,  ft  Society 

1976 

P.S 

Field. 

Sim 

Kaul  t 

Book 

1983 

p 

Lab. Sim 

Rehmann  et  al. 

Human  Factors 

1976 

p 

Sira 

Repa  &  Vterwl 1 le 

SAE  Paper 

1984 

p 

Lab 

Robe  r  t  son 

Proc.  Human  Factors  Society 

1982 

p 

Lab 

Rosenberg  et  al. 

Repot  t 

p 


1974 

P 

Sim 

RolEe  et  al. 

AGARD  Conference  Proceedings 

1978 

P 

Flight 

Roscoe 

Aviat.,  Space  &  Env.  Med. 

1978 

P 

Flight 

Sanders  et  al. 

Report 

1977 

S 

Flight 

Sanders  et  al. 

Proc.  Human  Factors  Society 

1978 

S 

Lab 

Savage  et  al. 

Human  Factors 

1978 

P.S 

Flight 

Schiffler  et  al. 

Report 

1976 

P.S 

Flight 

Schiffler  et  al. 

Report 

1980 

S 

Flight 

Schif lett 

Report 

1983 

P 

Sim 

Schif iett 

Report 

1985 

P 

Lab 

Schlegel  6 
Shingledecker 

Proc.  Human  Factors  Society 

1973 

P.S 

Lab 

Schorl 

Ergonomics 

1975 

S 

Lab 

Schorl  &  Jones 

J.  Motor  Behavior 

1970 

P 

Sira 

Schultz  et  al. 

Proc.  NASA  Conf.  Manual  Ctrl. 

1972 

P 

Lab 

Shiffrln  6  Gardner 

J.  Experimental  Psychology 

1987 

P 

Shively  et  al. 

AP 

1971 

P,S 

Lab, Sin 

Shulraan  6  Briggs 

Kepor  * 

1971 

P 

Lab 

Shulraan  6  Greenberg 

Journal  of  Experimental 
Psychology 

1976 

P.S 

Lab 

Siegel  et  al. 

Repor  t 

1977 

P 

Flight 

Simmons  6  Kimball 

AGARD  Conference  Proceedings 

1979 

S 

Fl Ight 

Simroons  f>  Klmbal  1 

Proc.  Human  Factors  Society 

1978 

P 

Fl Ight 

Simmons  et  al. 

Kepor  t 

1979 

P 

Sim 

Smith 

Kepor r 

1977 

P.S 

Lab, Sim 

Soedo 

Prcx'.  NASA  Conf.  Manual  Ctrl. 

1978 

p 

Sim 

Spady 

Kejxx  t 

19/1 

p 

Field 

Sperand io 

Kr gon<>-  it  % 

19/4 

P.S 

S  im 

Splcuzza  et  a! . 

Kepor  t 

1971 

P.S 

Lab 

Spyker  et  a  1 . 

Kepor  t 

197.1 

P.S 

Fl  Ight . 
Sim 

Stackhouse 

Repot t 

1976 

P.S 

S  im 

St ackhouse 

Repot ? 

197  l 

s 

Lab 

Stager  6  Muter 

J.  Kxper imen* a l  Psychology 

1972 

s 

Lab 

Stager  6  7.ufelk 

J.  Experimental  Psychology 

1985 

p 

Lab 

Stave  land  et  a  1 . 

Pr or .  Conf.  Manual  Control 

1979 

p 

Fl ight 

Stone  et  a l . 

Kepor  t 

1976 

s 

Fl Ight 

Storm  et  a l . 

Repot t 

1977 

p 

Lab 

St  rasser 

agaku  Conference  Proceedings 

1971 

p 

Lab 

Strasser  et  al . 

Aerospace  Medicine 

1978 

P.S 

Sim 

St  r leb  et  a  1 . 

Repot  t 

1976 

P.S 

Sim 

Sun  et  al . 

Proc.  Aviat  Electronics 

Symp. 

Org.  Behav.  f.  Human  Perf. 

1972 

P.S 

l.ab 

Trumbc  6  Noble 

1976 

p 

Sim 

Verplank 

Proto  NASA  Conf.  Manual  Ctrl. 

1977 

p 

Lab 

Verplank 

Proc.  NASA  Conf.  Manual  Ctrl. 

1988 

P.S 

Sim 

Vldullch  6  Bortolussl 

Proc.  Human  Factors  Society 

1981 

p 

l,ab 

Vldullch  &  Wlckens 

Kepor t 

1984 

p 

Iwib 

Vldullch  6  Wlckens 

Proc.  Conf.  Manual  Control 

1985 

p 

l.ab 

Vldullch  6  Wlckens 

Prcx:.  Symp.  Aviat.  Psychology 

1987 

p 

l.ab 

Vicente  et  al . 

Human  Factors 

1979 

p 

Lab 

Waller  et  al . 

Proc.  Human  Factors  Society 

1972 

P.S 

Lab 

Watson 

Koj>ort 

1975 

p 

Sim 

Waugh 

Ke(K)t  t 

4 


V) 


* 


1976 

P.S 

Lab 

Wewerlnke 

Proc.  NASA  Conf.  Manual  Ctrl 

1977 

P 

Flight 

Wewe  r Inke 

Proc.  NASA  Conf.  Manual  Ctrl 

1974 

P 

Sim 

Wewerlnke  &  Smlt 

AGARD  Conference  Proceedings 

1979 

P.S 

Lab 

Whitaker 

Acta  Psycho log lea 

1975 

s 

Lab 

White 

Report 

1975 

s 

Lab 

White  &  Gaurae 

Report 

1974 

P.S 

Lab 

Wickens 

Report 

1976 

P.S 

Lab 

Wlckens 

J.  Experimental  Psychology 

1977 

P.S 

Lab 

Wickens  &  Gopher 

Human  Factors 

1983 

p 

Lab 

Wlckens  &  Yeh 

Proc.  Human  Factors  Society 

1988 

P.S 

Sim 

Wickens  et  al. 

Proc.  Human  Factors  Society 

1984 

p 

Lab 

Wiener  et  al. 

Human  Factors 

1983 

p 

Sim 

Wlerwllle  &  Connor 

Human  Factors 

1985 

P.S 

Sim 

Wierwllle  et  al. 

Human  Factors 

1977 

p 

Lab 

Wlckens  et  al. 

Proc.  Human  Factors  Society 

1976 

s 

Lab 

Wlckens  et  al. 

Proc.  NASA  Conf.  Manual  Ctrl 

1977 

P.S 

Lab 

Wickens  &  Kessel 

Proc.  NASA  Conf.  Manual  Ctrl 

1979 

P.S 

Lab 

Wlckens  6  Kessel 

IEEE  Trans.  Sys.,  Man,  a  & 
Cybernet ics 

1977 

P.S 

Lab 

Wlckens  &  Pierce 

Report 

1979 

P.S 

Lab 

Wickens  Tsang 

Repor  t 

1979 

P.S 

Lab 

Wlckens  et  al. 

Proc.  Human  Factors  Society 

1978 

P.S 

Sim 

Wierwille  6  Gutmann 

Human  Factors 

1977 

P.S 

Sirr. 

W  i  e  r  •-  <  1 1  <  •  e  t  a  1  . 

Human  Factors 

1978 

P.S 

S  irn 

Wo  1  !  <• 

Repor  t 

1984 

p 

Lab 

Yeti  S.  Wickens 

Proc.  Human  Factors  Society 

1985 

p 

Lab 

Yeti  et  al  . 

Proc.  Human  Factors  Society 

1975 

P.S 

Lab 

ZeiMin  &  Finkelman 

Human  Factors 

1971 

P.S 

Lab 

Zeitlin  Si  Finkelman 

Exp  Pub.  Systems 

1 4 


TABLE  13.  Vision/Eye  Movement 


Year 

Authors 

Publication 

1984 

POV 

Lab 

Acosta  &  Dickman 

Proc.  Human  Factors  Society 

1979 

PO 

Lab 

Ahern  &  Beatty 

Science 

1988 

BR 

Lab 

Albery 

Proc.  Human  Factors  Society 

1977 

PD,  BR 

Lab 

Anderson  &  Chlou 

Report 

1977 

ES 

Flight 

Barnes 

AGARD  Conference  Proceedings 

1979 

CPP 

Lab 

Baschera  &  Grand  jean 

Int ’ 1  Ergonomics  Assoc. 

1987 

BR 

Lab 

Bauer  et  al. 

Human  Factors 

1985 

BR 

Lab 

Bauer  et  al. 

Psychophys iology 

1976 

PD 

Lab 

Beatty 

Proc.  NASA  Conf.  Manual  Ctrl 

1979 

POV 

Sim 

Bermudez  et  al. 

Proc.  Human  Factors  Society 

1983 

PD.EB.EF 

Sira 

Casa 11  &  Wierwille 

Human  Factors 

1984 

PD,  EB 

Sim 

Casali  &  Wierwille 

Ergonomics 

1977 

EME 

Lab 

Ceder 

Human  Factors 

1976 

ES 

Sim 

Clement 

Proc.  NASA  Conf.  Manual  Ctrl 

1974 

ES 

S  im 

Corklndale 

AGARD  Conference  Proceedings 

1976 

ES 

Sim 

Dick  6  Bailey 

Report 

1976 

ES 

Sim 

Dick  et  al , 

Repor  t 

1980 

ES 

S  im 

Ephrath  et  al. 

Proc.  Human  Factors  Society 

197b 

PD 

Lab 

Gardner  et  al. 

Perceptual  6  Motor  Skills 

1973 

EM 

Lab 

Gopher 

Perception  6  Psychophysics 

1982 

ES 

Sim 

Harris  et  al . 

Proc.  Human  Factors  Society 

1979 

ES ,  PD 

Sim 

Harris  6  Mixon 

Proc.  Human  Factors  Society 

1977 

EM 

Field 

Hay ash l  6  Ogawara 

.irnl.  Human  Ergo  logy 

1972 

BR 

Lab 

Holland  6  Tar  low 

Psychological  Reports 

1977 

PD 

Lab 

Juris  6  Velden 

1  ysiologlcal  Psychology 

1984 

HR 

Lab 

Kim  et  al . 

Proc.  Conf.  Manual  Control 

1976 

ES ,  PD 

Sim 

Krebs  6  Wingef  t 

Repor t 

1977 

ES .  P  D 

Sim 

Krebs  et  a  1 . 

Repot  t 

1976 

EM 

l.ab 

ixjrens  6  Darrow 

Elect  roen.  ft  Clin.  Neuro. 

1977 

ES 

Eli  <jh  t 

Lovesay 

AGARD  Conference  Proceedings 

1983 

EME 

Lab 

Ma  lmst  rom  et  a  1  . 

J.  Applied  Psychology 

1970 

ES 

Field 

Mourant  6  Rockwell 

Human  Factors 

1979 

EM,  PD 

Sim 

North  ft  Graffunder 

Proc.  Human  Factors  Society 

1972 

PD 

7 

Poock 

Pro:.  Human  Factors  Society 

1976 

KM 

Flight, 

Sim 

Rau  1 1 

Book 

1979 

ES 

Fl ight 

Sanders  et  al. 

Human  Factors 

1977 

ES 

Flight 

Sanders  et  a  1 . 

Proc.  Human  Factors  Society 

1979 

ES 

Fl ight , 
Sim 

Simmons 

Hu.Ta.t  Factors 

1977 

ES 

Fl ight 

Simmons  6  K imba 1 l 

AGARD  Conference  Proceedings 

1979 

ES 

Flight 

Simmons  6  K imba 1 1 

Proc.  Human  Factors  Society 

1978 

ES 

Fl ight 

Simmons  ft  Kimball 

Repor l 

1978 

ES 

Fl ight . 
Sim 

Lab 

Simmons  et  a  1 . 

AGARD  Conference  Proceedings 

1985 

HR 

S  l  moriov  6  Frol  ov 

Avlat.,  Space,  6  Knv .  Med. 

1977 

ES 

Sim 

Spady 

AOARD  Conference  Proceedings 

1978 

ES 

Sim 

Spady 

Report 

1974 

EM 

Sim 

Spicuzza  et  al. 

Report 

1971 

EM 

Lab 

Spyker  et  al. 

Report 

1984 

BR 

Sim 

Stern  &  Skelly 

Proc.  Human  Factors  Society 

1976 

EM 

Sim 

Waller 

Report 

1979 

EM 

Lab 

Waller  et  al. 

Proc.  Human  Factors  Society 

1970 

EM 

Sim 

Weir  &  Klein 

Proc.  NASA  Conf.  Manual  Ctrl 

1983 

PD.  BR 

Sim 

Wierwille  &  Connor 

Human  Factors 

1985 

PO.BR.EF 

Sim 

Wlerwllle  et  al. 

Human  Factors 

1982 

FOV 

Sim 

williams 

Human  Factors 

1985 

FOV 

Sim 

Williams 

Human  Factors 

1978 

EM,  PD 

Sim 

Wolfe 

Report 

BR  ■  Blink  Rate.  CFF  =  Critical  Pllcker  Frequency.  EM  *  Eye  Movement  Analysis, 
EME  Eye  Movement  Extent,  EF  x  Eye  Fixations,  ES  *  Eye  Scan  Analysis,  FOV  = 
Field  of  View,  PD  =  Pupil  Diameter 


EXPERIMENTAL  EFFORT 

In  an  effort  to  address  Issues  concerning  the  reliability  and  validity  of 
the  SLIT  technique,  we  proposed  a  series  of  experiments,  demonstrations  and 
proof  of  concept  trials.  We  have  attempted  to  preserve  the  numbering  from  the 
original  proposal  and  f rom  the  Annual  Report,  although  this  is  somewhat 
artificial  since  as  the  research  and  development  unfolded,  it  was  necessary  to 
add  experiments  in  some  cases  (e.g.,  3B).  In  other  cases  where  experiments 
were  planned  (e.g.,  blink  exclusion,  vertical  eye  movements)  these  were 
handled  by  software  techniques  and  were  merely  demonstrated  in  a  few 
subjects.  These  are  listed  below,  more  or  less  in  the  chronology  that  they 
were  conducted. 

All  experiments  employ  the  complex  counting  task  of  Jerison  (1956) 
modified  for  auditory  presentation  (Kennedy  &  Bittner,  1980)  and  which  we  have 
used  for  many  years  (Kennedy,  1971).  Among  the  chief  attributes  for  the 
present  study  were  that  the  task  stabilizes  reasonably  well  within  a  short 
practice  period  (l.e.,  factor  structure  of  the  task  does  not  change).  The 
apparatus  lends  Itself  to  inexpensive,  simple  data  collection  with  a  minimal 
data  analysis  time.  The  task  can  be  varied  (psychophysical ly  scaled)  almost 
infinitely  from  "too  simple  to  pay  attention  to  for  a  long  time  without 
becomlnq  bored'  to  an  "information  overload*  for  all  subjects.  The  task  has 
been  employed  in  over  two  dozen  studies,  and  over  1000  subjects  have  been 
tested  in  one  way  or  another  (cf..  Kennedy.  1971,  1975;  Kennedy  6  Bittner, 
1980;  for  reviews  of  the  task  and  its  metric  properties).  We  have  Implemented 
the  task  to  be  self  scoring  on  a  portable  computer  anJ  will  'run'  on  NEC 
PC8201A  and  IBM  compatible  systems.  Demonstration  copies  of  the  program  are 
available  on  request  from  Robert  S.  Kennedy,  PhD,  Essex  Corporation,  1040 
Woodcock  Road,  Orlando,  Florida,  32803.  The  counting  task  can  present 
auditory  (experiments  l,  3,  4,  and  5) ,  visual  (experiment  2)  stimuli  and  both. 
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EXPERIMENT  1:  THE  RELATIONSHIP  BETWEEN  SACCADE  LENGTH  AND  TONE  COUNTING 
PERFORMANCE 

Rationale 


The  purpose  of  this  experiment  was  to  employ  a  difficult  level  of  the 
counting  task  In  order  to  precisely  relate  saccade  length  to  performance 
measures.  However,  as  we  began  the  experiment  with  the  first  ten  subjects,  we 
found  that  l)  subjects  were  not  able  to  perform  the  task,  and  2)  there  was 
virtually  no  correlation  between  saccade  length  and  performance.  When  these 
subjects  were  brought  back  for  a  second  session  of  testing.  It  was  found  that 
tone  counting  performance  Improved  for  many  of  them.  Thus,  the  Importance  of 
practice  seemed  evident  and  we  opted  to  perform  experiment  3  (listed  below  as 
3A)  as  the  initial  research.  The  outcome  of  experiment  3  persuaded  us  that 
our  originally  proposed  experiment  1  was  llladvised  and  we  therefore  conducted 
a  more  promising  alternative  (experiment  7). 

EXPERIMENT  3A:  THE  EFFECTS  OF  PRACTICE  ON  SACCADE  LENGTH 

Rat  tonale 

Practice  of  a  difficult  task  results  in  more  efficient  performance  and. 
possibly,  the  reduction  of  mental  workload  associated  with  that  task.  Our 
previous  demonstration  (Phase  I,  second  experiment)  that  increased  task 
complexity  results  In  decreased  saccade  length  was  obtained  with  low  levels  of 
pretest  practice.  In  the  present  experiment,  we  examined  the  effects  of 
practice  on  saccade  lenqth.  Our  hypothesis  was  that  saccade  length  would 
increase  with  increasing  practice,  reflecting  the  decrease  in  task  load  that 
derives  from  increasing  automat ic i t y .  Such  a  result  would  provide  evidence 
that  SLIT  is  sensitive  to  an  Important  factor  (i.e.,  practice)  in  human 
performance . 


Method 

Ten  volunteer  subjects  were  employed  in  10  eye  movement  recording  sessions 
occurring  over  a  period  of  10  successive  days.  Each  subject  was  paid  $100,00 
at  the  completion  of  the  experiment. 

Apparatus 

An  infrared  eyetracking  instrument  was  used  to  record  eye  movements  from 
the  left  eye.  These  signals  were  applied  to  the  modulation  input  of  a 
voltage  controlled  frequency  generator  (Wavetek.  Model  148).  the  output  of 
which  was  fed  Into  a  signal  processor  (Nicolet,  Model  1072)  which  was 
programmed  to  accumulate  a  time  Interval  histogram.  in  this  fashion,  eye 
movement  extent  was  coded  In  terms  of  frequency  modulation. 

The  auditory  version  of  the  tone  counting  task  was  administered  with  a 
microprocessor  (NEC,  Model  8201A)  which  was  programmed  to  present  a  random 
series  of  36  low  pitch  tones,  28  medtum  pitch  tones  and  24  high  pitch  tones. 
Tone  durations  were  .5  seconds  and  the  same  temporal  distribution  was  repeated 
every  60  seconds,  but  the  subjects  did  not  recognize  that  a  pattern  was 
present.  The  task  required  that  subjects  hit  one  of  three  keys  after  each 
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fourth  low.  medium,  and  high  pitch  tones.  Three  separate  keys  were  used  to 
indicate  the  three  different  tone  counts.  Scoring  was  always  reset  in  the 
event  of  a  miss  or  an  Incorrect  response. 

Procedure 

Subjects  participated  in  10  sessions.  In  the  first  session,  each  subject 
performed  the  auditory  tone  counting  task  once  prior  to  recording  eye 
movements.  The  following  control  conditions  were  then  performed  for  five 
minutes  each  while  eye  movements  were  recorded:  (1)  a  fixation  condition  in 
which  subjects  fixated  a  small  cross  (subtending  10  min  of  visual  angle).  (2) 
an  alternating  fixation  condition  which  required  20  degree  saccades  at  an 
aperiodic  rate  (.2  Hz),  and  (3)  a  free-viewing  condition  in  which  subjects 
were  permitted  to  freely  move  their  eyes.  Pollowlng  the  control  conditions, 
eye  movements  were  recorded  while  subjects  performed  the  tone  counting  task 
for  five  minutes.  The  procedure  was  repeated  in  the  subsequent  nine  sessions 
except  that  subjects  were  not  given  the  pretest  practice. 

Results 


Data  reduction  involved  normalizing  the  range  of  saccades  for  fixation, 
free  viewing  and  task  related  saccades  by  dividing  these  measures  by  the  range 
for  alternate  fixation.  These  three  measures  and  the  performance  scores  (mean 
percent  correct)  for  each  session  were  submitted  to  an  analysis  of  variance. 
For  eye  movement  data,  a  condition  by  sessions  design  was  employed.  For  the 
tone  counting  performance  measure,  a  simple  repeated  measured  design  was 
employed . 

Mean  normalized  saccade  lengths  across  testing  sessions  are  depicted  in 
Klqure  I  for  each  condition.  The  mean  ranges  for  the  fixation  condition  are 
consistently  lowest  across  sessions,  while  those  for  free  viewing  are 
1  . ghest.  The  ranges  obtained  in  the  task  condition  fell  between  those 
obtained  for  the  free  viewing  and  fixation  conditions.  The  analysis  of 
variance  revealed  that  none  of  the  saccade  length  measures  changed 
systemat leal ly  with  practice  on  the  tone  counting  task.  These  conclusions  are 
supported  by  the  results  of  the  analysis  of  variance  which  revealed  a 
significant  main  effect  for  conditions  (F-10.1;  df  18:  p  <  .01  but  no  other 
significant  main  effects.  Newman  Keuls  tests  revealed  significant  differences 
between  the  fixation  and  free  viewing  conditions  (p  <  .001),  task  and 
free  viewing  conditions  (p  <  .05).  but  not  between  fixation  and  task 
cortd  1 1  ions  . 

In  Figure  2.  mean  saccadic  ranges  obtained  during  the  task  condition  have 
been  replotted  along  with  mean  tone  counting  performance  as  a  function  of 
practice  sessions.  It  is  apparent  in  the  figure  that  performance  Increased 
considerably  with  practice.  This  is  supported  by  the  results  of  the  analysis 
of  variance  which  revealed  a  significant  main  effect  for  sessions  (F  -  9.13; 
df  -  9.  18;  p  <  .01). 

Finally,  an  tntercorrelatlon  matrix  between  performance  and  saccade 
length,  collapsed  across  trials,  did  not  reveal  any  significant  correlations. 
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Fig.  1.  Mean  normalized  saccade  ranges  for  the  free-viewing  (FV), 
fixation  <FX).  and  task  (T)  conditions  across  ten  testing  sessions. 
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Pig.  2.  saccadic  ranoe  In  degrees  obtained  under  task  conditions 
and  tone  counting  performance  (percent  correct)  across  testing  sessions. 
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Discussion 


The  results  show:  (1)  that  the  average  saccade  length  obtained  while 
subjects  perform  a  difficult  tone  counting  task  is  restricted  compared  to 
free-viewing  conditions,  and  (2)  that  percent  correct  performance  on  the  tone 
counting  task  continued  to  improve  across  ten  testing  sessions  while  saccade 
length  was  not  modified  as  a  function  of  practice.  The  first  finding 
reinforces  the  contention  that  saccade  length  may  be  used  to  measure  mental 
workload.  The  second  finding  runs  contrary  to  the  original  expectation  that 
the  task  would  become  automated  with  practice  and  that  saccade  length  would 
Increase.  It  may  be  hypothesized  that,  although  subjects  were  getting  better 
at  the  tone  counting  task,  it  remained  a  "high*  workload  condition  which  was 
reflected  in  saccade  length  which  remained  constant  across  sessions.  If  this 
hypothesis  were  true,  then  it  could  be  expected  that  if  these  subjects  were 
administered  low  and  medium  difficulty  levels  of  the  tone  counting  task, 
saccade  length  should  reflect  the  decrease  in  workload  but  performance  should 
remain  high.  This  expectation  was  tested  in  an  additional  unplanned 
experiment  (experiment  3B>. 

EXPERIMENT  3B:  THE  EFFECTS  OF  EXTENDED  PRACTICE  AT  HIGH  WORKLOAD  ON  SACCADE 
LENGTH  OBTAINED  UNDER  LOW  AND  MEDIUM  WORKLOADS 

Rationale 

Following  the  rationale  outlined  above,  the  subjects  from  Experiment  3a 
who  had  the  best  performance  on  the  tone  counting  task  were  employed  to 
replicate  experiment  2  from  Phase  I. 

Method 

The  same  basic  control  conditions  which  were  employed  In  experiment  3A 
were  employed.  Then  then  were  required  to  perform  a  one  tone  counting  task 
(depressing  a  key  after  every  fourth  low  tone),  a  two  tone  counting  task 
(depressing  a  key  after  every  fourth  low  tone  and  another  key  after  every 
fourth  medium  tone),  and  then  a  three  tone  counting  task  (depressing  separate 
keys  after  every  fourth  low,  medium,  and  high  pitch  tones).  Each  of  the  tone 
counting  tasks  were  performed  for  five  minutes  under  free  viewing  conditions 
while  eye  movements  were  recorded. 

Results 

The  data  were  reduced  and  analyzed  as  in  experiment  3A.  The  mean 
performance  scores  (percent  correct)  and  the  Individual  differences  in  saccade 
lengths  were  normalized  and  are  presented  in  Figure  3  for  each  tone  counting 
condition.  As  is  apparent  in  the  figure,  tone  counting  PERFORMANCE  did  not 
vary  significantly  with  task  load,  as  expected.  In  contrast,  saccade  length 
(SLIT)  decreased  with  increased  task  difficulty,  also  as  expected.  Finally, 
the  correlation  between  saccade  length  and  tone  counting  performance  scores 
was  not  statistically  significant. 


Dlscufi.^  i 


Saccade  length  measured  In  subjects  who  performed  tasks  of  low,  medium, 
and  high  difficulty  reflected  changes  In  mental  workload  after  they  had 
extensive  practice  on  the  high  difficulty  level  of  the  task.  This  finding 
supports  the  hypothesis  that  workload  remained  constant  across  testing 
sessions  in  experiment  3A.  The  combined  results  of  experiments  3A  and  3B 
suggest  two  important  findings.  First,  the  saccade  length  measure  Is  not 
affected  by  extended  practice  under  difficult  task  conditions.  Thus,  under 
extended  practice  on  a  task  that  Induces  high  workload,  saccade  length 
reflected  workload  while  performance  did  not.  This  finding  Is  Important  given 
the  use  of  performance  Indices  to  measure  workload.  Moreover,  it  Is  a  partial 
answer  to  the  question  posed  for  experiment  1;  namely,  the  relationship 
between  SLIT  and  performance.  Second,  these  results  suggest  that  saccade 
length  remains  a  valid  measure  of  the  mental  effort  required  under  low  and 
medium  task  demand  levels  even  after  extended  performance  at  high  task 
difficulty  level.  This  finding  is  Important  given  the  Increasing  concern  with 
temporal  factors  Involved  In  workload  (e.g.,  Matthews.  1986)  and  the  possible 
effects  of  practice  on  workload  Indices  reported  In  other  research  (May, 
Kennedy,  Williams,  Dunlap,  &  Brannan,  1985;  Wilson,  McCloskey,  &  Davis,  1986). 
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Pig.  3.  Mean  normalized  saccade  length  and  tone  counting  performance 
(percent  correct)  under  low,  medium,  and  high  task  difficulty  levels 


EXPERIMENT  2:  THE  EFFECTS  OF  VISUAL  TASKLOAD  ON  THE  EXTENT  OF  SACCADIC  EXE 
MOVEMENT. 


Rationale 

Previously  (Phase  I  experiments  and  Experiments  3A  &  3B)  we  demonstrated 
that  the  extent  of  visual  saccades  decreased  as  task  complexity  Increased 
using  a  three  channel  auditory  tone  counting  task.  In  this  experiment,  we 
attempted  to  replicate  these  findings  while  using  an  analogous  visual  task 
which  did  not  require  precise  visual  fixation  or  tracking  but  did  require 
visual  monitoring  and  the  same  type  of  cognitive  effort  (i.e.,  counting). 

Thus,  this  experiment  addresses  the  issue  of  generalization  and  the  practical 
issue  of  \diether  the  SLIT  technique  can  be  employed  while  operators  perform 
visual  work,  obviously  if  visual  stimuli  interfere  with  SLIT  measures  (or 
were  necessary  for  triggering  it)  usefulness  would  be  limited. 

Method 

I - — 

Ten  subjects  who  were  paid  $10  for  their  participation  were  Instructed  to 
perform  low.  medium,  and  high  difficulty  levels  of  a  visual  counting  task 
while  eye  movements  were  recorded  using  the  same  methodology  reported 
previously  in  experiment  3A.  In  addition,  the  same  microcomputer  was  used  to 
administer  the  task,  but  the  microprocessor  was  reprogrammed  to  present  a 
series  of  three  dark  rectangles  (1  cm  X  2  cm)  on  the  face  of  a  LCD  screen. 

The  rectangles  were  arrayed  horizontally  in  three  channels  (left,  center,  and 
riqht)  with  the  left  and  right  rectangles  located  10  deqrees  to  each  side  of 
the  central  one.  The  screen  was  located  18  Inches  In  front  of  the  subject's 
bite  bar.  Each  rectangle  was  presented  for  one  second  and  their  order  of 
occurrence  was  aperiodic  with  the  average  rate  of  occurrence  being  .2  Hz. 

Under  the  three  counting  conditions  the  subjects  (1)  counted  each  occurrence 
of  the  left  rectangle  and  depressed  a  key  after  each  fourth  occurrence,  (2) 
ounted  the  occurrence  of  each  left  and  middle  rectangle  and  depressed 
different  keys  after  the  fourth  occurrence  of  each  one,  and  (3)  counted  the 
occurrence  of  each  left,  middle,  and  right  rectangle  and  depressed  different 
keys  after  the  fourth  occurrence  of  each.  Fixation,  alternating  fixation,  and 
free  viewing  control  conditions  were  run  as  described  previously  in  experiment 
3A . 

Resul t s 

Measures  of  rectangle  counting  performance  and  normalized  saecade  length 
were  computed  for  each  condition.  The  mean  saccadic  range  and  counting 
performance  scores  have  been  presented  In  Figure  4  for  each  counting 
condition.  The  performance  decrements  with  increasing  task  load  declined,  but 
overall  performance  was  quite  high  relative  to  that  for  tone  counting  in 
experiment  l.  Decreasing  saccade  length  was,  again,  associated  with  Increases 
In  task  difficulty.  Analysis  of  variance  revealed  significant  main  effects 
for  performance  (P  7.11;  df  2.18;  p  <  0.005)  and  saccade  length  (F  *  16.07; 
df  2,18;  p  <  0.0001) .  Subsequent  Newman  Keu Is  tests  revealed  that  performance 
under  hlqh  task  difficulty  was  slgnlf leant ly  lower  than  the  other  two 
conditions  (p  <  .008)  and  the  mean  saccadic  ranges  under  all  conditions  were 
significantly  different  from  each  other  (p  <  0.02  or  less). 
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Discus  it  Ion 

These  data  indicate  that  the  saccade  length  index  of  taskload  is  valid 
under  conditions  of  visual  channel  monitoring.  Thus,  it  appears  that  SLIT  may 
be  generalized  to  other  visual  performance  tasks  which  do  not  require  precise 
fixation  or  tracking. 
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Pig.  4.  Saccadic  range  in  degrees  and  visual  counting 
performance  scores  (percent  correct)  under  low,  medium, 
and  high  task  difficulty  levels. 


EXPERIMENT  7:  MEASUREMENT  OP  SLIT  WITH  A  VISUAL  FORCING  FUNCTION 


Rationale 


The  experiments  carried  out  to  date  indicate  that  the  eye  movements  are 
restricted  in  range  when  subjects  are  performing  tasks  Involving  high  degrees 
of  mental  workload.  The  present  study  examines  the  relationship  between 
saccade  length  and  workload  while  subjects  are  exposed  to  a  visual  forcing 
function  which  was  designed  to  simulate  the  dynamic  features  which  might  be 
viewed  from  an  aircraft  cockpit.  To  simulate  this  wi  employed  a  series  of 
stripes  which  normally  produces  optokinetic  nystagmus  (OKN)  -  related  to 
railroad  nystagmus.  One  of  two  outcomes  was  hypothesized  for  this  situation: 
l)  OKN  would  be  unaffected  during  the  task  and  saccade  length  will  no  longer 
be  related  to  the  level  of  task  complexity,  or  2)  OKN  would  be  inhibited  and 
the  degree  of  inhibition  will  increase  with  workload,  if  the  first  hypothesis 
were  confirmed  it  would  Imply  that  the  SLIT  technique  Is  not  useful  In 
situations  which  require  reflexive  eye  movements.  If  the  second  hypothesis 
were  confirmed,  it  would  imply  that  the  cognitive  load  results  in  a  reduction 
of  saccade  length  even  In  the  presence  of  provocative  stimulation. 


Method 


Ten  subjects  were  paid  $10  00  '♦ach  to  participate.  Optokinetic 
stimulation  was  provided  by  a  20  degree  field  of  verticaL  stripes  displayed  on 
a  color  aonltor  (Tektronix,  Model  690SR).  The  stripes  were  red  and  green  and 
had  spatial  frequency  of  1.2  c/d.  The  stripes  appeared  to  drift  to  the  right 
for  10  seconds  and  then  to  drift  to  the  left  for  10  seconds.  This  duty  cycle 
(.1  Hz)  was  repeated  for  five  minutes. 

Subjects  were  required  to  participate  in  the  control  conditions  as  in 
experiment  1  (fixation  and  alternate  fixation),  and  to  undergo  five  minutes  of 
optokinetic  stimulation  while  eye  movements  were  recorded.  Mext,  they  were 
required  to  perform  a  one-tone  counting  task  (depressing  a  key  after  every 
fourth  low  tone),  a  two-tone  counting  task  (depressing  a  key  after  each  fourth 
low  tone,  and  another  key  after  every  fourth  medium  tone),  and  then  a  three 
tone-counting  task  (depressing  separate  keys  after  every  fourth,  low.  medium, 
and  high  pitch  tones),  each  of  the  tone  counting  tasks  were  performed  for 
five  minutes  under  conditions  of  optokinetic  stimulation  while  eye  movements 
were  recorded. 

Results 


The  data  were  reduced  and  analyzed  as  in  experiment  l.  The  mean 
performance  scores  (percent  correct)  and  the  mean  saccadic  ranges  are 
presented  in  Figure  5  for  each  tone  counting  condition.  As  is  apparent  in  the 
figure,  tone  counting  performance  declined  significantly  with  task  load,  as 
expected.  Interestingly,  saccade  length  decreased  with  increased  task 
difficulty,  even  when  optokinetic  stimulation  was  used.  Finally,  the 
correlation  between  saccade  length  and  tone  counting  performance  scores  was 
not  statist lcally  significant. 
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Fig.  5.  Saccadic  range  in  degrees  under  optokinetic  stimulation  and 
performance  scores  (percent  correct)  under  low,  medium, 
and  high  task  difficulty  levels. 
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Discussion 

Saccade  length  measured  In  subjects  who  performed  tasks  of  low,  medium, 
and  high  difficulty  reflected  changes  in  mental  workload  even  under  conditions 
of  optokinetic  nystagnus.  This  finding  indicates  that  the  saccade  length 
index  of  workload  is  a  valid  measure  even  when  a  reflexive  visual  forcing 
function  is  employed. 

EXPERIMENT  4.  5  Si  6:  EXCLUSION  OP  BLINK,  VERTICAL  EYE  MOVEMENT  RECORDING  AND 
CORRELATION  OF  PHYSIOLOGICAL  MEASURES. 

During  the  last  year  our  effort  turned  to  the  software  development  as  the 
key  focus  of  our  effort.  As  we  moved  deeper  into  a  careful  development  and 
subsequent  debugging  of  the  software  and  scoring  protocols,  the  successful 
conduct  of  this  work  in  some  cases  precluded  the  need  for  experimental  work 
since  it  was  possible  to  demonstrate  the  requirements  once  the  software 
package  was  completed.  Recordings  were  made  with  the  newly  developed 
automat  leal ly  scored  system  (described  below  under  hardware  and  software 
development)  from  three  subjects  over  30  epochs  each  and  the  five  "different" 
physiological  variables  were  cast  into  a  correlation  matrix.  Left  and  right 
eye  measures  were  accomplished  separately.  In  general  there  was  a  bias  within 
a  subject  indicating  a  directional  preponderance  but  these  differences,  while 
reliable,  were  small,  it  is  important  however  to  have  this  capability  for 
r,om»  measurement  purposes  (e.g.,  when  diplopia  or  disconjugate  eye  movements 
are  suspected)  and  when  vergence/convergence  issues  can  surface  (e.g.,  with 
night  vision  goggles  or  visually  coupled  systems  are  in  use).  Table  14 
provides  correlat ional  data  for  the  five  "different"  phys iolog ica  l  variables 
which  are  used  in  our  standard  package.  It  may  be  seen  that  eyeblinks 
correlate  r  -0.40  (pc. 001)  with  SLIT  but  this  correlation  would  only  imply  a 
16  percent  overlap  between  the  two  measures.  It  would  seem  that  while  these 
two  indicants  are  related,  the  relationship  is  weak .  The  case  for  velocity 
and  SLIT  is  much  stronger,  and  this  is  not  surprising  since  similar  metrics 
(displacement,  speed,  duration)  are  employed  in  calculating  both  measures. 
These  reveal  a  50  percent  overlap  a  relationship  which  is  rational.  The 
other  measures  (saccade  frequency,  and  duration  <>t  saceades)  may  turn  out  to 
be  useful  measures  in  future  studies. 


TABLE  14.  Intercor relat ions  of  Saccade  Frequency.  Duration, 
Length,  Blink  Kate,  and  Velocity 


Frequency 
Durat Ion 
Blinks 
Velocity 
SLIT 


Frequency 

Durat ion 

B) inks 

Veloc ity 

SLIT 

1.00 

0.23 

0.40** 

0.20 

1 .00 

0.12 

0.74** 

l  .00 
0.23 

1.00 

0.04 

0.12 

0.09 

0.71** 

1.00 

**p  <  .001 

N  •  90 
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GENERAL  DISCUSSION 


The  major  finding  of  these  Investigations  is  that  the  range  of  extent  of 
spontaneous  eye  movements  decreases  as  cognitive  workload  demands  increase. 
This  is  the  case  when  an  auditory  counting  task  is  used  and  also  when  a  visual 
counting  task,  which  does  not  involve  fixation  or  tracking,  is  employed.  The 
results  of  experiment  3  indicated  that  the  saccade  length  measure  is  not 
affected  by  extended  practice  under  difficult  task  conditions.  Thus,  under 
extended  practice  on  a  task  that  Induces  high  workload,  saccade  length  indexed 
objective  conditions  of  workload  while  performance  increased.  This  finding  is 
Important  given  the  previous  use  of  performance  indices  to  measure  workload 
because  it  implies  that  the  method  may  be  very  stable  and  relatively 
Independent  of  practice  effects.  Finally,  *he  results  of  experiment  seven 
suggest  that  saccade  length  remains  a  valid  measure  of  the  mental  effort 
required  under  low,  medium,  and  hlqh  task  difficulty  even  in  the  presence  of  a 
reflexive  visual  forcing  function.  This  finding  Is  Important  given  the 
Increasing  concern  with  temporal  factors  involved  in  workload  (e.g.,  Matthews, 
1986)  and  the  possible  effects  of  practice  on  workload  Indices  reported  in 
other  research  (Wilson,  McCloskey,  &  Davis,  1986).  Moreover,  this  finding 
makes  SLIT,  along  with  blink  and  other  nontrlggered  events  very  important 
adjuncts  for  use  In  real  world  situations  where  it  Is  not  necessary  to  have  to 
"see  through"  stimuli  which  are  required  by  other  metrics. 

These  findings  raise  interesting  questions  regarding  previous  reports  of 
attentlonal  constriction  during  conditions  of  high  levels  of  mental  workload. 
If  this  phenomenon  is  associated  with  an  attempt  to  restrict  information 
processing  to  a  limited  portion  of  the  central  visual  field,  then  it  stands  to 
reason  that  a  concommltant  restriction  of  eye  movements  would  facilitate  such 
a  process.  Future  research  aimed  at  assessing  attentlonal  constriction  and 
eye  movement  '-xtent  under  varying  levels  of  cognitive  workload  would  furthet 
elucidate  th.'  relationship. 

HARDWARE  AND  SOFTWARE  DEVELOPMENT  EFFORT 


GENERAL  ANALYSES 

The  techniques  employed  in  the  present  invest igat ion  Included  two  serious 
limitations  which  we  set  out  to  rectify  in  the  development  portion  of  the 
present  effort.  First,  the  eye  tracking  apparatus  was  insensitive  to  eye 
movements  In  non  horizontal  meridians.  It  may  be  possible  to  use  similar 
techniques  with  Instruments  which  track  vertical  as  well  as  horizontal  eye 
movement  signals.  Second,  the  apparatus  employed  did  not  allow  for  the 
exclusion  of  eyebllnks.  As  Stern  6  Skelly  (1984)  have  shown,  cyeblinks  change 
under  conditions  of  cognitive  workload  and  It  may  well  be  that  a  system  which 
measures  both  frequency  of  eyebllnks  and  saccadic  range  uncontaminated  by  the 
former  would  offer  a  more  sensitive  Index  of  taskload.  A  final  caveat 
concerns  the  applicability  of  this  technique  to  real  world  settings.  Although 
the  apparatus  used  in  the  present  study  required  a  chin  block  for  head 
stabilization,  other  less  restrictive  methods  are  available  and  need  only 
involve  head  mounted  eye  monitoring  equipment.  In  what  follows  we  employ  a 
system  where  the  head  is  fixed  for  calibration  and  then  held  stationary  by  a 
chin  block  which  is  less  restrictive  than  a  bite  board.  If  additional 


channels  of  Information  were  available  for  recording  of  head  position,  there 
would  be  no  technical  reasons  why  eye  movement  recordings  could  take  place 
while  the  head  were  unrestricted. 

Relatedly,  we  considered  the  possible  artifacts  In  eye  movement  recording 
which  could  result  from  oculomotor  system  Interactions  (e.g.,  accommodation, 
vergence  and  convergence).  tiese  Issues  were  surfaced  during  equipment 
hardware  and  software  design  conferences.  They  were  considered  to  be 
Important  Issues  throughout  this  effort  but  of  less  importance  when  compared 
to  problems  which  occur  due  to  the  Intrusion  of  blinks.  Moreover,  by 
recording  vertical  and  horizontal  eye  movements  separately  and  excluding 
eyebllnks  through  our  software  programs,  we  believed  some  of  the  problems  with 
vergence  would  either  be  removed  through  the  separate  recording  or  could  be. 
More  expensive  data  analytic  systems  (i.e.,  more  channels  and  more  storage) 
could  have  eliminated  these  artifacts  further  but  we  did  not  consider  the 
additional  expense  warranted  at  this  stage  of  development  of  SLIT. 

Since  we  ate  able  satisfactorily  to  measure  the  movement  of  both  eyes 
separately,  we  see  no  Important  technical  issues  in  addressing  this  issue  in 
future  versions  of  this  system  provided  that  there  are  sufficient  channels  and 
computer  storage  capability.  Likewise,  we  know  that  accommodation  can  be 
measured  in  real  time  (Powlkes,  Kennedy  &  Hennessy,  1987)  and  have  done  so. 
Accomodation  can  be  removed,  but  because  measurement  and  recording  of  this 
Information  also  adds  considerable  to  the  cost  (and  thereby  limits  future 
portability)  we  have  only  reckoned  with  this  issue  in  our  scientific  meetings 
and  discussions.  The  relationship  of  accommodation  and  arousal  (i.e., 
emotion)  has  been  addressed  in  another  context  (Fowlkes,  Kennedy  &  Hennessy, 
1987).  We  believe  these  two  techniques  (dark  focus  and  SLIT)  should  be  merged 
when  both  are  developed  further.  At  the  present  time  Incorporating  the  two 
would  complicate  and  (more  importantly)  retard  the  development  of  both.  These 
oculomotor  effects  when  compared  to  those  of  other  concerns  were  small  and 
have  therefore  employed  this  form  of  analysis  to  address  these  potential 
ar  1 1 f acts . 

In  summary,  we  have  attempted  to  answer,  either  by  provocative  test  or 
analysis,  those  problems  which  we  considered  to  be  significant.  We  defined 
significant  to  be  those  which  were  necessary  and  sufficient  for  ultimate  use 
of  the  b locyber net ic  system.  We  have  relegated  problems  believed  to  be  less 
critical  to  the  successful  funct ionlng,  particularly  when  they  represented 
high  cost  items,  to  a  lower  level  of  Importance  and  dealt  with  them  through 
consensus . 

Therefore,  in  parallel  with  the  experimental  effort  we  conducted  a  formal 
hardware  and  software  development  effort  to  produce  a  prototype  of  a 
quasiportable,  and  versatile  SLIT  system.  Development  took  cognizance  of  the 
experimental  results  and,  where  practical,  incorporated  features  found 
beneficial  (e.g.,  two-dimensional  eye  movement  recording,  eyebllnk 
rejection).  Experimental  demonstrations  of  these  features  were  accomplished 
in  this  effort  and  are  described  more  fully  below.  Development  was  concerned 
with  key  technical  Issues  which  did  not  lend  themselves  easily  to  experimental 
solution,  or  which  required  customized  software  programs  to  effect  outcomes 
which  were  deemed  necessary  from  the  experimental  effort  (viz.,  computer 
selection,  interfaces,  and  software). 
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COMPUTER  SELECTION 


We  purchased  a  PC's  LIMITED®  12  MHz  286  microcomputer  as  the  main 
processor  of  the  SLIT  system.  The  computer  has  640  kilobyte  main  memory,  1.92 
megabytes  of  expanded  memory,  (giving  a  total  of  2.5  megabytes  of  addressable 
memory),  a  72  megabyte  hard  disk  configured  as  three  23  megabyte  hard  drives, 
a  1.2  megabyte  and  360  kilobyte  floppy  disk  drives,  an  Intel  80287  math 
co-processor;  and  thus  has  sufficient  computational  power  for  the  SLIT 
system.  The  video  interface  was  an  EGA  compatible  display  controller  with  a 
Mitsubishi  RGB  EGA  monitor.  A  comparably  equipped  IBM  PC-AT  (TM)  would  have 
cost  almost  75  percent  more,  yet  would  not  have  delivered  the  necessary 
processor  speed  and  disk  storage  to  handle  the  amount  of  data  collected. 

In  year  two,  we  would  have  purchased  a  portable  microcomputer  [e.g., 

COMPAQ  386  (TM) ]  which  would  have  enabled  SLIT  to  be  t ranspor table  and  used 
for  field  testing.  However,  with  the  introduction  of  the  IBM  MicroChannel 
(TM),  along  with  a  shortage  of  256K  CMOS  DRAM  chips;  the  price  of  the  portable 
computers  capable  of  performing  this  task  proved  to  be  prohibitive  to  this 
effort  . 

INTERFACES 

Interface  Issues  concerned  t he  development  of  a  head  mounted  recording 
system,  easily  applied  surface  electrodes,  reliable  arr.pl  i  f  icat ion,  and  an 
analog  to  digital  converter. 

We  have  experimented  with  both  s i 1 ver /% i 1  vet  biocide  and  gold  surface 
electrodes  and  with  different  met  hods  of  attaching  them.  Currently,  we  favor 
4  mm  si  1 ver /silver  chloride  electrodes  for  HOG  recordings.  Subjects  were 
instructed  to  thoroughly  wash  their  fee  and  left  'nner  wrist.  After  a 
complete  scrub  down,  subjects  were  instructed  to  lightly  huff  with  sand  i;>er 
t  tie  seven  locations  where  t  tie  electrodes  would  he  applied  (see  Figure  The 

seven  sites  were  then  cleaned  with  an  .alcohol  swab,  and  the  e  l  e<  t  codes  wet  e 
app 1 1 ed . 


Subject,  impedance  was  fben  ■  he.-ked  by  >  •  >nne.  ting  r  tie  ground  electrode 
(  i .  e .  ,  the  one  attached  t  ■  (tie  -..jbje,  ?*s  wrist)  t>-  the  common  <>t  an  otr  "eier. 
connecting  a  reference  elertrode  to  t  tie  positive  pin.  arid  setting  the  -cte:  to 
PxlOOO.  It  was  determined  ttiat  a  good,  clean  signal  could  he  obtained  if  l  he 
measured  resistance  of  each  ol  *  tie  sin  (  a<  e  ele.  t  codes  measured  less  than 
IS, 000  ohms.  If  this  test  passed  our  maximum  impedance,  t  tie  surface 
elect  r  odes  were  then  connected  to  t  tie  three  amplifiers. 

We  used  three  reliable  amplifiers  featuring  chat a<  t er 1st ics  suitable 
for  EOT.  recording.  The  three  amplifiers  (2  vertical  channels,  1  horizontal) 
were  EOG  amplifiers  obtained  on  loan  f  rom  the  U.s.  Navy,  and  were  powered  by 
Hewlett  Packard  MP6217A  Power  supplies,  also  on  loan  from  the  U .  S .  Navy. 

We  purchased  a  MetroByfe  cot  (-or  at  ion  DAS  16k  8  channel  (bipolar) 
analog  to  digital  converter  capable  of  sampling  up  to  100,000  samples  per 
second  to  serve  as  the  SI, II  Interface  *o  the  microprocessor.  The  DAS  16F  also 
provides  2  D/A  channels,  and  8  Digital  I/O  Channels.  The  interface  provides 
for  0  different  voltage  selections,  plus  a  user  option  is  available  for 
customizing  your  own  voltage  ranges.  Connecting  to  t  tie  DAS  16F  via  a  1/  pin 
ribbon  cable,  we  purchased  an  STA  16  Screw  Terminal  Hoar  >1  which  enable  ns  'o 
easily  mcxllfy  our  cabling  t  egu  1 1 '-merit . 
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In  all  our  experiments,  we  selected  *2.b  volts  for  signal  gain,  giving  us 
a  resolution  of  1.22  millivolts.  For  the  later  experiments,  we  sampled  three 
different  channels  (1  horizontal,  2  vertical)  at  256  samples  per  second  each 
(i.e.,  256  samples  per  second  (SPS)  for  the  horizontal  channel,  256  SPS  for 
the  left  eye  vertical  movement,  256  SPS  for  the  right  eye  vertical  movement). 

We  designed  and  built  our  own  calibration  board  which  doubled  as  the 
visual  version  of  the  counting  task.  This  board,  (Figure  7),  contains  8  red 
LEDs  imbedded  in  a  four  foot  square  panel  which  was  painted  black.  The  LEDs 
are  controlled  via  software  using  the  8  digital  I/O  channels  provided  by  the 
DAS-16P.  With  the  subject  seated  6  feet  from  the  center  of  the  board,  and  at 
e/e  level,  40  degrees  of  vertical  and  40  degrees  of  horizontal  distance 
separate  the  top/bottom,  left/right  LEDs,  with  10  degrees  of  separation 
between  each  LED. 


*  +20 


*  +10 


-20  -10  0  +10  +20 

degrees 


*  -  10 


♦  -  20 

Fig.  7.  Oil ibrat ion /Visual  Count inq  Board 


SOFTWARE  OVERVIEW 

With  the  purchase  of  the  DAG  16F,  we  also  acquired  FORTRAN  IV  object 
odules  to  aid  In  the  sampling  of  Analog  to  Digital  channels,  the  progt  ar.r  i  rig 
of  the  on  board  Heal  Tim*?  Clock,  and  programming  of  the  Digital  1/0  channels. 
This  library  Is  used  extensive ly  In  each  of  the  software  programs  described 
be  low. 

We  have  written  software  for  the  GI.IT  system  to  potrr.it  storage  (if 
analog  to  dlqltal  conversions  of  eye  movement  signals  (including 
two  dimensional  recording),  data  archiving,  and  Immediate  play  back.  In 
addition,  software  has  been  written  to  rake  a  novice  SI  IT  system  user  through 
calibration  techniques  and  actual  use  of  the  system. 

While  It  would  have  been  desirable  to  have  lmrr.edl.it e  on  line  scoring  of 
saccade  lengths,  eyeblinks,  and  saccade  durations.  It  was  found  that  with  the 
computations  Involved,  (even  with  the  high  speed  processor  in  use).  It  was  not 
feasible  without  an  increased  expenditure  for  more  expensive  and  faster 
hardware . 

Currently,  wc  are  able  to  analyze  a  two  and  a  half  minute  session  and  have 
the  results  stored  In  an  intermediate  file  in  less  than  two  minutes,  with  the 
price  of  fast  DRAM  chips  comlnq  down  to  a  reasonable  figure,  and  with 
Increased  availability,  most  80386  machines  are  now  within  the  price  range  of 
the  system  we  originally  purchased;  and  we  would  anticipate  that  concurrent 
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processing  of  the  data  collected  during  a  session  is  now  a  fiscally  prudent 
possibility. 


DESCRIPTION  OF  THE  SOFTWARE  MODULES 

All  of  the  executable  nodules  are  kept  on  a  single  partitioned  drive  of 
the  computer.  In  our  case  in  directory  BIOC.  The  source  code  for  the  Essex 
developed  modules  are  located  in  a  sub-directory  as  are  the  libraries  used  for 
linkage.  Data  are  collected  in  the  main  directory,  and  after  an  experimental 
run,  are  'squashed',  archived,  and  stored  in  a  DAT  sub-directory. 

There  are  four  modules  which  need  be  executed  to  cycle  through  an 
experimental  run:  LIVESHOW.  BIOC,  SQUASH  and  SCORE. 

LIVESHOW  is  run  prior  to  beginning  the  data  recording,  and  after  the 
electrodes  have  been  tested.  Because  there  tends  to  be  a  slight  drift  in  the 
signals,  from  the  beginning  of  a  session  to  the  end,  It  is  necessary  to  ensure 
that  all  signals  start  on  the  zero  Line.  '  LIVESHOW  enables  to  experimenter  to 
center  each  signal  prior  to  the  execution  of  the  experiment  by  displaying  the 
incoming  signals  from  the  subject  on  the  BOA  monitor. 

Once  the  hardware  has  been  calibrated,  the  run  t ime  data  recording  task, 
BIOC,  is  executed.  Upon  execution,  the  experimenter  is  prompted  for  a  three 
letter  subject  identifier,  most  often  the  first  letter  of  the  subjects  first, 
middle  and  last  name.  The  experimenter  then  enters  the  order  of  the  tasks  to 
be  performed  by  the  subject,  (L.e.,  high,  middle,  or  low  demand). 

Each  workload  level  is  broken  down  into  two  2.S  minute  sessions.  A 
software  calibration  period  precedes  and  follows  each  2.S  minute  session.  It 
was  decided  to  place  a  calibration  section  at  the  end  rtf  a  session  due  to  the 
sllqht  drift  that  occasionally  occurs.  With  a  calibration  period  at  the 
beginning  and  the  end  of  each  session,  fjnatic  compensation  can  take  place 
in  the  scoring  module.  The  software  calibration  routine  successively 
Illuminates  the  calibration  LEDs  in  the  following  order:  2.0  degree  vertical, 

10  degrees  vertical,  *10  degrees  vertical,  ♦ 20  degrees  vertical,  20  degrees 
horizontal,  10  degrees  horizontal,  *10  degrees  horizontal,  *20  degrees 
horizontal  and  0  degrees  (center  I.KD).  The  subject  is  instructed  to  fixate  on 
the  illuminated  LED  and  one  second's  worth  of  data  is  collected  and  stored  in 
the  data  file. 

The  next  ISO  seconds  worth  of  data  consist  of  the  a>  t  ua  1  eye  movement 
data,  followed  by  9  seconds  of  calibration  data  and,  finally,  the  pet  for  trance 
scores  for  the  trial  session.  Data  are  stored  as  2's  complement  two  byte 
Integer  values,  using  the  upper  12  bits  of  the  word.  The  first  word  of  the 
file  is  data  for  A/U  channel  0,  the  second  is  channel  1  and  the  thin)  word  is 
channel  2.  Data  arc  stored  in  the  above  order  for  each  sample  taken  during 
the  run.  Since  we  sampled  at  2S6Hz ,  one  second  worth  of  data  takes  IS36  bytes. 

After  the  last  workload  level  is  completed,  (when  the  exper Imenial  run  is 
over),  the  SQUASH  module  is  executed  to  compress  the  file.  Due  to  the  timing 
of  writing  to  the  disk,  sometimes  zero  data  is  transferred  into  the  file. 
SQUASH  removes  this  non  data  and  effectively  cuts  file  size  by  approximately 
23  percent .  Since  a  complete  testing  session  generates  over  2.*}  megabytes  of 
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data,  SQUASH  effectively  reduces  this  amount  to  nearly  2  megabytes.  After 
scoring  the  data,  we  further  compressed  the  data  using  PKARC,  an  archiving 
program,  which  reduced  the  size  of  the  data  flies  to  about  1.25  megabytes,  and 
then  we  moved  the  archive  to  the  OAT  subdirectory. 

The  SCOBS  module  prompts  the  experimenter  for  the  three  letter  subject  ID, 
and  asks  whether  or  not  a  visual  display  of  the  data  Is  desired.  The  data  for 
each  testing  session  is  then  read,  scored,  and  results  are  printed  in  file 
SACCADS.DAT,  and  Is  also  displayed  on  the  BOA  monitor.  If  a  visual  display  of 
the  data  was  requested,  the  vertical  channels  are  displayed  In  blue,  and  the 
horizontal  channel  Is  displayed  In  green.  Two  seconds  worth  of  data  is 
display  on  the  monitor  at  a  time.  The  next  frame  of  data  Is  displayed  by 
pressing  any  key  on  the  keyboard.  Saccades  are  identified  by  vertical  green 
lines,  and  eyebllnks  are  Identified  with  a  vertical  blue  line.  A  sample 
report  generated  by  the  SCOBS  module  can  be  seen  in  Pigure  8.  As  can  be  seen 
from  the  figure,  each  session  Is  broken  down  into  five  30  second  epochs. 
Results  reported  for  each  epoch  are  saccades  per  second,'  average  duration  of  a 
saccade,  average  duration  of  a  left  going  saccade,  average  duration  of  a 
right-going  saccade,  number  blinks,  average  estimated  saccade  velocity, 
average  SLIT  per  epoch,  average  left-going  SLIT  per  epoch  and  average 
right-going  SLIT  per  epoch.  Also  reported  are  average  durations  of  saccades 
for  the  session,  average  SLIT  score  per  session,  the  number  of  saccades  per 
minute,  and  number  of  blinks  per  minute.  The  final  listing  displays  subject 
performance  on  the  counting  task. 

Saccade  identification  is  comprised  of  three  stages:  the  first  identifies 
saccade  Initiation,  the  second  saccade  termination,  and  the  third  computes  the 
voltage  delimited  by  these  points  to  arrive  at  the  size  of  the  saccade .  To 
identify  saccade  initiation,  the  program  calculates  the  absolute  difference  in 
amplitude  between  five  successive  samples  (19.5  ms)  from  the  horizontal 
channel.  Tf  all  five  differences  exceed  3.66  millivolts  AND  ate  in  the  same 
direction,  a  tentative  saccade  Initiation  is  flagged.  Saccade  tertr.lnat  ion  is 
determined  by  searching  for  five  successive  samples  whose  differences  are  less 
than  3.66  millivolts.  If  saccade  termination  criteria  is  not  met  within'  00 
ms,  the  tentative  saccade  Is  flagged  as  a  false  saccade,  and  not  included  in 
the  data  analysis. 

The  size  of  the  saccade,  SLIT,  is  computed  by  taking  the  absolute 
difference  in  amplitude  of  the  end  of  the  saccade  from  the  beginning  of  the 
saccade.  This  results,  in  millivolts,  is  then  multiplied  by  the  scale  factor 
obtained  from  the  calibration  routines  to  arrive  at  the  number  of  degrees  the 
eye  moved.  Duration  of  the  saccade  Is  computed  by  simply  subtracting  the 
number  of  the  data  point  which  began  the  saccade,  from  the  ending  data  point 
number  and  multiplying  by  the  known  sample  rate,  which  in  this  case,  is 
256Hz.  For  example,  if  a  saccade  began  at  data  point  number  1412,  and  ended 
at  data  point  number  1466,  the  duration  of  the  saccade  would  be  34  x  .0039063, 
giving  a  result  of  132.8  milliseconds.  Velocity  of  the  saccade,  in  degrees 
per  second,  is  estimated  from  dividing  the  SLIT  score  obtained  above  by  the 
duration  of  the  saccade. 

Eye  blinks  are  relatively  easier  to  detect.  The  vet t leal  channels  are 
monitored  for  quick,  positive  successive  slopes.  If  five  successive  samples 
show  this  trend,  a  tentative  blink  flag  Is  set.  The  termination  of  a  blink  is 
detected  by  checking  for  five  successive  samples  with  quick,  negative  slopes. 
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SUMMARY /APPLICATIONS 


The  idea  which  prompted  the  present  research  was  that  biological  events 
■ay  be  predictive  of  the  attentional  and  task  demands  of  work.  If  these  could 
be  analyzed  in  real  time  and  fed  back  to  the  machine  (or  operator),  a  truly 
blocybernetic  system  could  be  created.  For  example,  we  know  there  may  be 
little  or  no  deterioration  in  operational  performance  until  the  point  of 
failure  is  closely  approached,  but  perhaps  sensitive  biological  measures  of 
workload  could  provide  premonitory  signs  of  Impending  failure.  There  are  two 
technical  developments  which  must  be  accomplished  to  produce  a  workable 
system.  One  is  traditionally  a  human  factors  effort,  and  in  the  case  of 
bioelectric  events,  neurophysiological  and  biomedical  as  well.  The  other 
entails  engineering  development.  Including  software  and  hardware.  In  this 
work  we  have  set  out  to  accomplish  both. 

This  project,  which  was  conceived  to  be  carried  out  in  three  phases, 
entails  the  Invest igat Lon  of  a  physiological  output  of  the  human  organism  to 
be  employed  as  feedback  Information  to  systems  in  order  reduce  task  loading  to 
acceptable  levels;  specifically,  an  eye  movement  index  of  mental  workload  was 
studied.  Phases  l  &  11,  funded  by  APOSR,  have  been  completed  and  a  prototype 
is  available.  Future  plans  call  for  a  Phase  III  which  will  combine  Essex 
development  funding  with  federal  and  private  sector  support  in  order  to  make  a 
fully  up  and  running  system  available  to  the  technological  community. 

In  Phase  1.  two  Invest igat ions  were  performed  to  assess  the  feasibility  of 
using  specific  character  1st ics  of  eye  movement  saccades  as  unobtrusive 
indicants  of  mental  workload.  Eye  movements  were  measured  while  subjects  were 
differentially  task  loaded  by  simple,  moderate,  and  complex  auditory  tone 
counting.  The  results  indicated  that  the  extent  of  saccadic  eye  movements 
varied  Inversely  in  subjects  as  tone  counting  complexity  increased. 

The  second  Phase  1  experiment  used  the  same  equipment  and  explored  further 
the  relationship  of  eye  movement  measures  (saccade  length)  to  workload.  At 
this  point  we  also  incorporated  findings  from  the  literature  on  eye  movement 
extent  where  preliminary  experimental  evidence  showed  extent  of  eye  movements 
might  be  reduced  under  conditions  which  Induced  high  levels  of  arousal.  For 
example,  others  reported  a  restriction  of  pursuit  eye  movement  range  during  a 
concurrent  auditory  task  and,  more  pointedly,  found  that  restriction  in 
saccade  length  occurred  In  cats  under  conditions  of  high  arousal  Induced  by 
amphetamines.  To  organize  our  activities  we  employed  a  2X2  classlf leal  ion 
schema  which  we  believe  will  Improve  descriptive  precision  and  permit  improved 
communication  of  ideas.  The  classif lcat Ion  follows  from  statistical  theory, 
and  we  believe  that  it  should  have  heuristic  use  as  well. 

Therefore,  to  test  the  relationship  between  saccade  length  and  arousal, 
subjects  in  the  second  Phase  I  experiment  performed  an  auditory  tone  counting 
task  at  three  levels  of  difficulty  while  saccadic  eye  movements  were 
recorded.  Performance  varied  inversely  with  difficulty  level  of  the  tone 
countlnq  task  suggesting  that  the  different  task  conditions  Induced  different 
levels  of  mental  workload.  This  relationship  was  substant iated  by  a 
significant  linear  trend  (P(l,4)  *  9.10,  p  »  .04).  Average  extent  of  saccadic 


eye  movements  was  also  related  to  task  difficulty  so  that  saccade  length  was 
restricted  with  increased  task  difficulty  level  (P(1.4)  -  16.65,  £  -  .02).  To 
further  substantiate  the  relation  of  saccade  length  to  workload,  correlation 
coefficients  between  saccade  length  and  performance  were  computed  for  each 
subject.  The  correlations  ranged  from  r  *  .37  to  r  *  .99  with  a  mean  of  r  ■ 
.64.  Thus,  the  results  from  this  research  suggested  that  saccade  length  could 
be  a  promising  objective  measure  of  the  task  demands  of  a  display  and  thereby 
serve  as  a  useful  measure  of  mental  workload. 

The  purpose  of  Phase  II  was  to  develop  further  the  Saccade  Length  Index  of 
Taskload  (Workload)  or  SLIT  and  cross-valldate  the  results  of  Phase  I.  The 
ultimate  outcome  of  Phase  II  would  be  prototype  development  of  a  transportable 
system  to  assess  mental  workload  via  the  SLIT  metric  and  other  bioelectric 
measures  as  appropriate,  A  chief  Ingredient  In  Initial  development  of  such  a 
system  would  be  a  Coeds  on  rapid  (i.e.,  seconds)  evaluation  of  the  bioelectric 
events  so  that,  when  properly  Identified  and  classified,  such  signals  could  be 
fed  back  to  signal  generators. 

This  work  was  divided  Into  three  main  thrusts:  net a- ana lysis. 
Experimentation,  and  Software  Development.  The  meta-analysis  section  has  two 
components  -  a  literature  review  as  well  as  a  quantitative  meta-analysis. 

The  sections  on  experimentation  describe  a  series  of  studies  which  address 
various  aspects  of  Implementing  and  measuring  Sl.1T.  The  software  development 
section  outlines  the  procedure  and  implementation  of  the  apparatus  and  scoring 
used. 


In  summary,  experimentation  involved  a  series  of  interlocking  experiments 
and  proof  of  concept  demonstrations.  In  the  studies  performed  in  this  series, 
reliable  data  were  obtained  with  as  few  as  three  subjects,  provided  there  were 
sufficient  calibrations  and  stable  baselines  of  performance  measures.  Wc 
found  that  saccade  length  index  of  task  load  was  related  to  the  workload  under 
which  the  operator  performs  end  not  wi'  1  performance  pej  se.  That  is.  the 
predictive  validity  of  Sl.1T  is  chiefly  as  an  index  of  the  objective 
information  load  to  the  operator,  even  when  vtsual  tasks  are  employed.  This 
finding  surfaced  when  the  effects  of  practice  were  examined.  Practice  did  not 
have  as  much  effect  on  SLIT  as  did  the  objective  index  of  task  loading. 
Therefore,  while  performance  improved  when  tasks  of  different  difficulty  were 
practiced  for  many  sessions,  it  appeared  that  the  chief  determinant  of  saccade 
length  was  the  number  of  channels  which  were  monitored.  The  SLIT  effect, 

•which  was  originally  demonstrated  in  the  dark  with  an  iuditory  task,  was 
obtained  in  a  lighted  room  while  monitoring  a  visual  signal,  thus  broadening 
potentially  the  applicability  of  the  phenomenon.  Also.  In  a  simulated  field 
test.  SLIT  was  demonstrated  to  be  robust  even  when  a  visual  forcing  function 
(optokinetic  nystagmus)  was  present,  in  the  feasibility  demonstrations, 
vertical  and  horizontal  eye  movements  became  resolvec’  and  left  and  right  eye 
recordings  were  also  separated.  The  former  was  a  necessary  condition  for 
isolating  blinks,  and  the  latter  war  a  first  step  in  removing  artifacts  from 
the  eye  movement  records  which  might  be  due  to  other  oculomotor  activities 
(e.g.,  vergence,  convergence,  and  accommodat ion) . 

A  preliminary  meta  analysis  was  conducted  to  synthesize  the  literature  on 
workload  measures  and  was  presented  in  a  series  of  tables,  in  general,  the 
number  of  performance  based  measures  appeared  to  be  on  the  upsurge  over  the 
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past  decade  and  physiological  measures  not  Involving  eye  movements  appeared  to 
be  on  the  downswing.  The  number  of  subjective  measures  of  workload  studies 
were  stable.  Investigations  of  ocular-based  measures,  particularly 
cortlcal-evoked  potentials,  were  on  the  Increase.  The  chief  finding  from  a 
fully  quantltltatlve  meta-analysls  of  the  ocular-based  measures  found  a 
sufficient  predicate  for  continuing  the  directions  of  the  Saccade  Length  Index 
of  Taskload  (Workload)  (SLIT)  research  since  predictive  validities  of  eye 
movement  research  In  general  appeared  to  be  robust  (particularly  eyebllnk). 
and  several  types  of  studies  which  examined  eye  movement  extent  (like  SLIT) 
were  considered  to  hold  promise. 

Software  development  occurred  when  the  work,  originally  conducted  In  the 
more  controlled  environment  of  a  university  laboratory  using  stationary 
equipment  (e.g..  Infrared,  head-fixed,  oculometer)  and  hand  scoring,  was 
transferred  to  the  the  contractor's  Orlando  field  offices.  Th6re  the  software 
and  hardware  development  continued  and  a  series  of  proof  of  concept  and 
feasibility  demonstrations  were  undertaken,  A  low-cost  microprocessor  was 
selected  for  the  SLIT  system  and  software  was  developed  and  customized  to 
produce  a  quasl-por table  system.  The  customized  program  has  the  ability  to 
reject  blinks  and  It  Is  possible  to  Integrate  eye  movement  records  and  deliver 
analyses,  automat  leal ly  scored,  within  2.5  minutes.  The  software  program 
possesses  many  scoring  and  Integration  features  (viz.,  left  vs.  right  eyes, 
vertical  vs.  horizontal,  vei nee /convergence  differences  can  be  separated, 
velocity.  •  eye  movements),  which  will  easily  be  accommodated  by  larger 
capacity,  more  permanently  emplaced,  laboratory  systems. 

A  nonlntrusive  reliable  measure  of  individual  differences  such  as 
attention  during  monitoring  and  control  tasks  has  obvious  blocybernet ic 
relevance,  particularly  in  dynamic  environments.  Such  a  technique  could  also 
be  employed  to  measure  pilot  performance  and,  through  feedback,  permit 
Improved  weapon  systems  operations.  The  possible  commercial  applications  of 
SLTT  for  the  private  sector  are  cons iderable .  SLIT  may  be  used  as  an 
Independent  assessment  of  an  individual's  attention  which  may  wane  with  time 
on  task  or  due  to  other  factors.  Such  a  relationship  might  be  of  interest 
during  quality  control  on  assembly  linos,  or  in  remote  emplacements  whore 
security  displays  are  monitored.  Since  SLIT  size  appears  to  be  proport  Iona l 
to  workload,  displays  and  workstations  could  be  evaluated  objectively  and 
compared  for  difficulty  level.  In  addition,  preliminary  evidence  suggests 
that  individual  differences  in  saccade  length  may  be  sufficiently  reliable  so 
that  they  could  be  studied  for  stability  over  time  and  then  examined  for 
relations  to  equipment  and  operator  aptitude  tradeoffs  in  systems  designs. 


56 


REFERENCES 


Gasman,  J-,  Mulder,  G.,  &  Mulder,  L.  J.  M.  Operator  effort  and  the  measure- 
ment  of  heart-rate  variability.  Human  Pactors.  1987,  29.  161-170. 

Acosta,  E.  Jr.,  &  Dlckaan,  J.  D.  Information  processing  In  the  visual 

periphery:  Influence  of  mental  workload.  Proceedings  of  the  H»—*n  Pactors 
society  28th  Annual  Meeting,  pp.  737-739.  Human  Factors  Society,  Santa 
Monica,  CA,  1984. 

Ahern,  S.  K.,  &  Beatty,  J.  Physiological  signs  of  Information  processing  vary 
with  Intelligence.  Science.  1979,  205,  1289-1292. 

Ahern,  s.  K.,  &  Beatty,  J.  Physiological  evidence  that  demand  for  information 
processing  capacity  varies  with  Intelligence.  In  M.  Friedman,  J .  p.  Dos, 

6  N.  O'Connor  (Eds.),  Intelligence  and  learning.  New  York,  Plenum,  1981. 

Anderson,  d.  B.,  &  Chlou,  W.  C.  Physiological  parameters  associated  with 

extended  helicopter  flight  missions;  An  assessment  of  pupl 1 lographlc  data. 
Final  Report  USARRL  77*21,  U.S.  Army  Aeromedlcal  Research  Laboratory,  Fort 
Rucker,  AL.  1977. 

Aurton,  J.  i.,  Kant ow It z ,  b.  H..  Mcc.Ulem,  C.  D.,  f.  Plonski,  M.  p.  Electro^ 
magnetic  metrics  of  mental  workload,  AFOSR  8‘j  0117,  Air  Force  office  of 
Scientific  Research,  Bollinq  Air  Force  Base,  DO.  1987. 

Barnes.  J.  A.  Use  of  eye  movement  measures  to  establish  design  parameters  for 
helicopter  Instrument  panels.  Proceedings  of  t ho  AGAR_D  Conference  on 
Methods  to  Assess  Workload.  AGARD  CPP  216,  Advisory  Group  for  Aerospace 
Research  arid  Development,  Neutlly  sur  Seine,  France,  1977. 

Bateman,  R.  P.  An  heuristic  approach  to  work  analysis.  Proceedings  of  the 
2lrd  Annual  Meeting  of  the  Human  Factors  Society,  pp.  v>4  SS7,  Human 
Factors  Society,  Santa  Monica,  CA,  1979. 

Bauer,  L.  O. ,  Goldstein,  H.,  6  Stern,  J.  A.  Ft  f  rv  t  .  <if  information 

processing  demands  on  physiological  response  patterns.  Human  Factors, 

1987,  29(2).  213  234. 

Beatty,  .j .  Task  evoked  pupillary  responses,  processing  load,  and  the 

structure  of  processing  resources.  Psychological  Bulletin,  1982.  91(2), 
2/6  292. 

Beatty,  J.  Pup l l lomet r ic  measurement  of  cognitive  workload.  Proceedings  of 
the  12th  Annual  NASA- University  on  Manual  Control,  pp.  13S  143.  1976. 

Beatty.  J.  Puplllometr Ic  methods  of  workload  evaluation:  Present  status  and 
future  posslblllt les.  In  H.  O.  Hartman  and  R.  K.  McKenzie  (Eds.).  Survey 
of  methods  to  assess  workload.  AGARD  At;  246.  1979. 


Beatty,  J.,  &  Wagoner.  0.  L.  Pup 1  Horae trie  signes  of  brain  activation 

vary  with  level  of  cognitive  processing.  Science.  1978,  199.  1716-1718. 


Beatty,  J.,  &  Wagoner,  B.  L.  Pupilloraetruc  signs  of  brain  activation 

vary  with  level  of  cognitive  processing.  Science.  1978,  199.  1216-1218. 

Benel,  8.  A.,  Coles,  M.  G.  H.,  Benel,  D.  C.  R.  Elect rodermal  lability  and 
individual  differences  in  simulataneous  monitoring  and  tracking. 
Proceedings  of  the  23rd  Annual  Meeting  of  the  Human  Factors  Society. 

Human  Factors  Society.  Santa  Monica,  1979. 

Biers,  D.  W.,  &  Mas line,  P.  Alternative  approaches  to  analyzing  SWAT  data. 
Proceedings  of  the  Human  Factors  Society  31st  Annual  Meeting,  pp.  63-66. 
Santa  Monica,  CA,  Human  Pactors  Society.  1987. 

Boff,  K.R.,  6  Lincoln,  J.E.  Criteria  for  selection  of  workload  assessment 
techniques.  Engineering  data  compendium:  Human  perception  and  perfor¬ 
mance.  Wright- Patterson  APB,  OH.  1988. 

Bortolussl,  M.  R.,  Kantowitz.  B.  H.,  S>  Hart,  S.  G.  Measuring  pilot  workload 
in  a  motion  base  trainer:  A  comparison  of  four  techniques.  Proceedings  of 
the  Third  Symposium  on  Aviation  Psychology,  pp.  263  270,  Ohio  State 
University,  Columbus,  OH,  1985. 

Bradshaw,  J.  L.  Pupil  size  and  problem  .solving.  Quarterly  .Journal  of 
Experimental  Psycho 1 ogy ,  1968.  20.  life  122. 

Bursill,  A.  E.  The  restriction  of  peripheral  vision  during  exposure  to 

hot  and  humid  conditions.  Quarterly  Journal  of  Experimental  Psychology, 
1958,  10.  113  129. 

Casali,  J .  G.  A  sens! t ivt ty/ int rus Ion  comparison  of  mental  workload  est Ima 
t  ton  techniques  using  a  simulated  flight  task  emphasizing  perceptual 
piloting  behaviors.  Ph.l).  Thesis.  Virginia  Polytechnic  Institute  and 
State  University,  Blackburg,  VA,  1982. 

casali,  J.  G. ,  6  Wierwille.  W.  W.  On  the  measurement  of  pilot  perceptual 

'workload:  a  comparison  of  assessment  techniques  addressing  sensitivity  and 
intrusion  issues.  Ergonomics.  27(10),  t984,  103  i  1050. 

Coder,  A.  Driver's  eye  movements  as  related  to  attention  in  simulated 
traffic  flow  conditions.  Human  Factors,  1977.  19.  571  581 

Chapanis,  A.,  Garner,  W.  R . ,  Morgan,  C.  T..  6  Sanford.  E.  H.  Lectures  on  men 
and  machines:  An  introduction  to  human  engineering.  Systems  Research 
Laboratory,  Baltimore,  MD,  1947. 

Clement,  W.  F.  Investigating  the  use  of  a  moving  map  display  and  a 

horizontal  situation  indicator  in  simulated  powered  life  short  haul 
operat ions .  Proceedings  of  the  12th  Annual  NASA-Unlverslty  Conference  on 
Manual  Conl.ol,  NASA  TMX  73170.  pp.  201  224.  1976. 


58 


Cohen,  B.,  Feldman,  H. ,  &  Diamond,  S.  P.  Effects  of  eye  movement,  brain-stem 
stimulation,  and  alertness  on  transmission  through  lateral  geniculate  body 
of  monkey.  Journal  of  Neurophysiology,  1969,  32.  583-594. 

Collins,  V.  B. ,  Cramp ton,  W.  E.,  &  Posner,  J.  B.  Effects  of  mental  activity 
on  vestibular  nystatsnus  and  the  electroencephalogram.  Nature.  1961,  190, 
194-195. 

Collins,  V».  B.,  6  Posner,  J.  B.  Electroencephalogram  alpha  activity  during 
mild  vestibular  stimulation.  Nature.  1963,  199,  933-934. 

Cooper,  G.  B.,  6  Harper,  R.  P.  The  use  of  pilot  rating  In  the  evaluation  of 
aircraft  landing  qualities.  National  Aeronautics  and  Space  Administra¬ 
tion,  Ames  Research  Center,  TN-D-5153,  Moffett  Field,  CA,  1969. 

Crabtree,  M.  S.,  Bateman,  R.  P..  &  Acton,  W.  H.  Benefits  of  using  objective 
and  subjective  workload  measures.  Proceedings  of  the  Human  Factors 
Society  28th  Annual  Meeting,  pp.  950  953,  Human  Factors  Society.  Santa 
Monica,  1984. 

Cronunelink,  M. ,  6  Roucoux,  A.  Character  1st tes  of  cat's  eye  saccades  In 
different  states  of  alertness.  Brain  Research.  1976,  103,  574  578. 

D’tmos.  U.  Subjective  workload  and  Individual  differences  in  Information 
processing  abilities.  Proceed t rigs  of  the  Fourth  Annual  Aerospace 
Behavioral  Engineering  Technology  Conference,  pp.  71  74,  1984a. 

Uamos,  0.  L.  Individual  differences  in  multiple  task  performance  and 

subjective  estimates  of  workload.  Perceptual  and  Motor  Skills.  1984b,  59, 
567  580. 

D.r  .,  0.  I..  Examining  the  re  1  at  tonshlp  between  subjective  estimates 
of  workload  and  Individual  differences  . In  .performance,  NASA  OK  P.141 
National  Aeronautics  and  Space  Administration,  Washington,  1X7,  1984i. 

Uamos,  D.  L.,  Bittner,  A.  C.,  dr.,  Kennedy,  K.  S..  6  Harheson,  M.  M.  The 

effects  of  extended  practice  on  dual  t ask  training.  Human  Factors,  1981. 
23,  627  631 . 

Uamos,  U.,  6  Smist,  T.  Individual  dilferences  in  multi  task  response 

strategies.  Proceedings  of  the  Human  Factors,  Society  25th  Annual  Meeting, 
pp.  291  295,  Human  Factors  Society,  Santa  Monica,  1981. 

Uaroff.  R.  B.,  6  Hoyt,  W.  F.  In  Mach  y  Rita  and  Collins  (Eds.),  Symposium 
on  the  Control  of  Bye  Movements.  Academic  Press,  New  York,  1971. 

Ulck,  A.  O. ,  6  Bailey,  0.  A  comparison  between  oculorooter  data  and  pilot 

opinion  on  the  usefulness  of  instruments  during  landing.  Technical  Repot t 
no.  3  76.  University  of  Rochester,  Center  for  Visual  Science,  Rochester, 
New  York,  1976. 

01  tchburn ,  R .  w . .  Eye  movement  s  .and  v i stjaJ.  percept  ton . 

Press,  New  York,  1973. 


59 


Oxford  University 


Donchln,  E.,  &■  Kramer,  A.  The  event-related  brain  potential  as  an  Index 
of  Information  processing:  A  program  of  basic  research,  AFOSR-CPL-86-1, 

Air  Force  Office  of  Scientific  Research,  Bolling  AFB,  DC,  1986. 

Donchln,  B.,  Wickens,  C.,  &  Coles,  M.  G.  H.  The  event-related  brain  poten¬ 
tial  as  an  Index  of  information  processing,  cognitive  activity,  and  skill 
acquisition:  A  program  of  basic  research.  Cognitive  Psychophysiology 
laboratory.  Department  of  Psychology,  University  of  Illinois,  Annual 
Progress  Report  CPL83-4/P49620-79-C-0233,  Champaign,  IL,  1983. 

Edwards,  D.  C.,  &  Goolkasian,  P.  A.  Peripheral  vision  location  and  kinds 
of  complex  processing.  Journal  of  Experimental  Psychology.  1974,  102, 
244-249. 

Eggemeier,  F.  T.  Some  current  Issues  in  workload  assessment.  Proceedings  of 
the  Human  Factors  Society  24th  Annual  Meeting,  pp.  669  673.  Human  Factors 
Society.  Santa  Monica,  CA,  1980. 

Eggemeier.  F.  T. ,  Shingledecker ,  C.  A.,  6  Crabtree,  M.  s.  Workload 

measurement  in  system  design  and  evaluation.  Proceed i ngs  of  the  Human 
Factors  Society  29th  Annual  Meeting ,  pp.  216  219,  Human  Factors  Society, 
Santa  Monica,  CA,  1986. 

Fowlkes,  J.E.,  Kennedy,  K.s. ,  6  llennessy,  R.T.  Relevance  of  visual 

accommodat ion  for  performance  in  spacecraft.  NASA  Contract  No.  NAS9 
17746,  NASA  Lyndon  H.  Johnson  Space  Center,  Houston,  TX ,  August  1987. 

Frazier,  T.  w.  Effects  of  transitory  behavior  stress  on  17  hydroxycorti 
costeroid  and  catechol  amine  levels.  Proceedings  of  the  Second  Annual 
Biomedical  Research  Conference.  Manned  Spacecraf t  Center,  Houston,  TX, 
1966. 

Frazier,  M.  I,..  Crumble ,  K.  H.  (Eds.).  Proceedings  of  the  Workshop  on 
Ft  Ight  Test.  Ing  to  Identify  Pilot  Workload  and  Pilot  Dynamics,  AFFTC 
TK  82  6,  Air  Force  Flight  Test  Center.  Edwards  Mr  Force  Has**,  c'A.  1987. 
(OTIC  No.  AD  A 129  3  33) 

Gopher.  D.,  6  Hraune,  k.  On  the  psychophysics  of  'workload:  Wtiy  bottler  with 
subjective  measures?  Hitman  Factors.  1984,  26(6),  619  632. 

Gopher,  l). ,  6  Uonchin,  K.  Workload  an  examination  of  the  concept .  In.  K.  k. 
Boff,  L.  Kaufman  6  J.  P.  Thomas  (Eds.),  Handbook  of  perception  and  human 
performance .  Wiley,  New  York,  1986. 

Gopher,  D.  Chlllag.  N.,  6  Arzi,  N.  The  psychophysics  of  workload  A  second 
look  at  the  relat lonship  between  subjective  measures  and  performance. 
Proceedings  of  the  Human  Factors  Society  29th  Annual  Meeting,  pp. 

640  664.  Human  Factors  Society,  Santa  Monica,  CA,  1986. 

Green.  B.  F.,  &  Hall.  J.  A.  Quantitative  methods  for  literature  reviews. 

Annua  1  Review  of  Psychology.  1984,  36,  37  63. 


60 


Mature. 


Hakerem,  G. ,  &  Sutton,  S.  Pupillary  response  at  visual  threshold. 

1966.  212,  485-486. 

Hale,  H.  B.,  Williams,  Smith,  B.  N. ,  &  Melton,  C.  E. ,  Jr.  Excretion  patterns 
of  air  traffic  controllers.  Aerospace  Medicine,  1971,  42(2),  127-138. 

Hall,  R .  J.  Eye  movement  fixations  and  gating  processes.  In  R.  A.  Monty  & 
J.  W.  Hall  (Eds.),  Eve  movements  and  psychological  processes.  Erlbaum, 
Hillsdale,  MJ.  1976. 

Hall,  R.  J..  &  Cusack,  B.  L.  The  measurement  of  eye  behavior:  critical 
and  selected  review  of  voluntary  eye  movement  and  blinking ,  Tech .  Memo 
18-72,  U.S.  Army  Human  Engineering  Laboratory.  Aberdeen  Proving  Ground, 
MU,  1972. 


Harris,  K.  L. ,  Sr.,  Tole,  J.  R.,  Ephrath,  A.  R.,  6  Stephens,  A.  T.  How  a  new 
instrument  affects  pilots*  mental  workload.  Proceedings  of  the  Human 
Factors  Society  26th  Annual  Meeting,  pp.  1010  1013,  Human  Factors 
Society,  Santa  Monica,  CA,  1982. 


Hart,  S.  G . ,  ft  Uortolussl,  M.  R.  Pilot  errors  as  a  source  of  workload.  Human 
Factors,  1984.  26,  545  556. 


Hart,  S.  G . ,  Childress,  M.  K.,  &  Bortolussl,  M.  Defining  I  he 
experience  of  workload.  Proceedings  of  i he  Human  Factors 
Annual  Meeting,  pp.  52/  531.  Human  Factors  Society,  Santa 


subject ive 
Society  25t_h 
Monica.  CA.  1981  . 


Hess,  K.  H.,  ft  Polt,  .1.  M.  Pupil  size  as  related  to  interest  value  of  visual 
stimuli,  science,  i960,  132,  349  350. 


Hess ,  K.  H..  f,  Pr>  1 1  ,  J.  H.  Pupil  size  in  relation  t  o  mental  activity  during 
simple  problem  solving.  Science,  1964,  143,  1190  1192. 

Holmes,  l).  t...  Cohen,  K.  M.  ,  Haith,  M.  W.  ,  ft  Morteson,  F.  ,J.  Peripheral 
visual  processing.  Perception  and  Psjfchophys irs ,  19  //,  22.  5  /  1  57  /. 

House  Armed  Services  Committee,  Defen.se  Policy  Panel  Hearings  on  the  downing 
of  Iran  Air  Flight  655,  The  effects  of  human  factors  on  combat  porfot 
malice,  October  1988. 


Jo r Won.  H.  J.  Kffec.  of  a  combination  of  noise  and  fatigue  on  a.  complex 
counting  task,  WADC  TK  55  360.  Wright  Air  Development  Center.  Wright 
Patterson  AFB,  Dayton,  OH,  1956. 

Kahneman,  D.,  ft  Beatty,  J.  Pupil  diameter  and  load  on  memory.  Science,  1966, 
154,  1583  1585. 

Kahneman,  D.,  ft  Beatty,  J.  Pupillary  responses  In  a  pitch  dls<  c  iminat  ion 
task.  Percept  ion  &  Psychophysics.  2.  1967.  1 0 1  105. 

Kahneman,  D.,  Beatty,  J.  6  Pollack,  1.  Perceptual  deficit  during  a  mental 
task.  Science.  1967,  157,  218  219. 


Kahneman,  D.,  Onuska,  L.,  &  Wolman,  R.  E.  Effects  of  grouping  of  the  pupillary 
response  In  short-term  memort  task.  Quarterly  Journal  of  Experimental 
Psychology,  1968,  20,  309-311. 

Kantowltz,  B.  H.,  &  Sorkln,  R.  D.  Human  factors  understanding  people- system 
relationships.  New  York,  Wiley,  1983. 

Kantowltz,  B.  H.,  6  Weldon,  M.  On  scaling  performance  operating  character¬ 
istics:  Caveat  Emptor.  Human  Factors,  1985,  27(5),  531-547. 

Kennedy,  R.  S.  A  comparison  of  performance  on  visual  and  auditory  monitoring 
tasks.  Human  Factors.  1971,  13(2),  93  97. 

Kennedy,  R.  S.  The  relationship  between  habituation  to  vestibular  stimulation 
and  vigilance:  Individual  differences  and  subsidiary  problems,  NAMHL 
Monograph  No.  20,  Naval  Aerospace  Medical  Research  Laboratory.  Pensacola, 
FI..  1975. 

Kennedy,  R.  S,  The  relationship  between  vigilance  and  eye  movements  Induced 
by  vestibular  st  lmulat  Ion .  In  R.  K.  Mackle  (Ed.),  V  i  g  1  lance Theory ,_ 
operational  performance,  and  physiological  correlates,  pp.  575  602.  New 
York,  Plenum. 

Kennedy,  K.  5.  bioelectric  indicants  <  >  1  diver's  ability  to  pet  Cur::,  useful 

work.  Proceed i ngs  of  the  undersea  Medical  society  Workshop.  Hethesda,  ML'. 
1978.  (AD  AO 60  675) 

Kennedy,  R .  5.,  6  bit  trier,  A.  C .  ,  .It.  Development  of  Performance  Evaluation 
Tests  for  Environmental  Reseat  ih  (PETER):  Cotr.pl  ex  count  ing.  Aviation, 
apace,  and  Environmental  Medic  in,',  1980,  51.  M2  144. 

Kir,  W.  ,  Zangem.e  1  st  er  ,  W.  ,  6  r.t  at  V  .  I..  No  ,-ttect  on  fatigue  on  blink  rate. 

In  a .  O.  Mart  6  E.  J .  Hart /ell  (Ed-..),  Twentieth  Annual  Conference  on 
Manual  Control.  National  Aeronaut  i-  s  and  Spare  Administration,  NASA  cp 
2341,  Washington,  lx;,  1984. 

Kr<d>:>,  M..J.,  Winger  t,  J.W.,  6  Cutm  i  ughur ,  T.  Exploration  of  an  ocu lometer 

based  model  of  pilot  workload.  NASA  Cp  14515  ),  76  :KC/39,  Honeywell.  Inc. 

Systems  6  Research  Center,  Minneapolis,  MN .  197/. 

¥  r  i  voh  1  avy  ,  .)  .  ,  K<  «la  t  ,  V  .  .  6  I'l/i't,  P  .  Visual  efficiency  and  fatigue  during 

i  he  af  t  e t  no,  in  sfi  i  f  t  .  Kt  gonotr  i  •  s  .  1969.  ;  .  ,  /  15  '40  . 

bane,  N.  E.,  Kennedy.  K.S.,  6  .Jones,  M.lt.  <  ivti  ing  unreliability  in 

operational  measures:  The  use  of  surrogate  measu.e  systems.  Proceedings 
of  the  70th  Annual  Meeting  of  the  Human  Ea<  tors  Society,  pp .  1  198  1402, 

Santa  Monica,  CA,  1986. 

Lewis,  fi.  W.  Bioelectric  predictors  of  personnel  performance:  A  review  of 
relevant  research  at  the  Navy  Personnel  Research  and  Development  Center, 
Navy  Personnel  Research  and  Development  Center,  NPKDC  TK  84  3.  San  Diego, 
CA,  1983a. 


Lewis,  G.  V.  Bioelectric  and  blomagnetlc  predictors  of  military  performance: 
Relevance  for  aviation  personnel.  Paper  presented  at  1983  Fail  Technical 
Meeting  of  the  Tri-Service  Aeroraedical  Research  Panel,  wright-Patterson 
AFB,  OH,  1983b. 

Macworth,  N.  H.  Visual  noise  causes  tunnel  vision.  Psvchonomlc  Science. 
1963,  3,  67-68. 

Malmstrotn,  F.  V.,  &  Reed,  L.  E.  Restriction  of  pursuit  eye  movement  range 
during  a  concurrent  auditory  task.  Journal  of  Applied  Psychology.  1983, 
68(4),  565-571. 

Malmstrom,  F.  V..  Reed,  L.  E..  &  Randle,  R.  J.  Restriction  of  pursuit  eye 
movement  range  during  a  concurrent  auditory  task.  Journal  of  Applied 
Psychology,  1983,  68,  565-571. 

Mane,  A . f  &  Wlckens,  C.  D.  The  effects  of  task  difficulty  and  workload  in 
training.  Proceedings  of  the  Human  Factors  Society  30th  Annual  Meeting, 
pp.  11241127,  Human  Factors  Society,  Santa  Monica,  CA,  1986. 

May,  J.  G . ,  Kennedy,  R.  S.,  Williams,  M.  C. ,  Dunlap,  W.  P. ,  &  Brannan,  J.  R. 
Eye  movements  as  an  index  of  mental  workload.  Final  Report,  Contract 
F49620  8S-C  0121,  Air  Force  Office  of  Scientific  Research,  Bolling  Air 
Forte  Base,  DC,  1985. 

Matthews,  M.  L.  The  influence  of  visual  workload  history  on  visual  perfor 
•nance.  Human  Factors,  1986,  28,  623  6  32. 

MrCloskey,  K .  Evaluating  a  spatial  task:  Behavioral,  subjective,  and 

physiological  correlates.  Proceedings  of  the  Human,  Factors  Society  3 1st 
Anrn:  il  Meeting.  Human  Factors  Society.  New  York.  1987. 

Merr  i.T.an,  S.  C.  ,  6  Cha teller ,  P.  R .  Impact  on  the  Department  of  Defense 
Science  and  Technology  Program  on  training  and  personnel  systems 
t echnology .  Office  of  Environmental  and  Life  Sciences,  Washington,  I>C, 
1981.  ( NT IS  No.  AD  A103382) 

Monty,  K.  A.,  Hall,  R.  J.,  6  Ros<*nber ger ,  M.  A.  Eye  movement  responses  to 
heroin  addicts  and  controls  during  word  and  object  recognition.  Neuro 
pharmacology ,  1975,  14,  697  107. 

O'Donnell,  R.  D.  I)eve lopment  of  a  neurophysiological  test  battery  tor 
workload  assessment  in  the  IJ.S.  Air  Force.  Proceedings  of  the  Inter¬ 
national  Conference  on  Cybernet les  and  Society,  pp.  398  402.  IEEE, 
Atlanta,  OA.  1981. 


O'Donnell,  R.,  Eggemeler,  T.  Workload  assessment  methodology.  In  K.  R.  Hoff, 
L.  Kaufman  &  J.  P.  Thomas  (Eds.)  Handbook  of  perception  and  human 
performance.  Vol.  T_I_.  Cognitive  processes  and  performance.  Wiley,  1986. 

O'Donnell,  R.  D.,  6  Shlngledecker ,  C.  A.  Behavioral  and  physiological 

monitor lng  and  predict  ion  of  operator  status  and  capabl Illy ,  Final  Report. 
Contract  No.  DAMD17  86  C  6114.  Department  of  Defense,  Washington,  DC,  198h. 


y .  Heart  rate  variability:  A  new  Index  of  driver  alertness/ 

Human  Factors  Research.  Inc..  TR-1712-I,  Goleta.  CA,  1971. 

Parry,  M.  E..  &  Harasymlw,  S.  J.  Percentage  of  pupillary 
as  a  measure  of  Item  difficulty.  Perception  &  Psychophysics. 

).  139-143. 

Using  plplllometry  as  an  Indicator  of  an  operator's  overload. 

•s  of  the  Human  Factors  Society  16th  Annual  Meeting,  pp.  197-198, 


tslngledecker ,  C.  A..  &  Eqgeraeler,  F.  T.  Applications  of  con¬ 
crement  to  workload  scale  development.  Proceedings  of  the  Human 
:letv  25th  Annual  Meeting.  Human  Factors  Society,  Santa  Monica, 


Some  aspects  of  the  selective  process  In  the  functional  visual 
■  -mnomlcs,  1970,  13(1),  101117. 

A  queueing  analysis  of  the  air  traffic  controller’s  workload, 
-art Ions  on  Systems.  Man,  and  Cybernetics,  pp.  492  498,  SMC  8, 

..  i  Reid,  t>.  J.  Anecdotal  Information  on  space  adaptat  ion 
ASA/Space  Biomedical  Research  Institute,  USRA/Divislon  of 
lie ine ,  July  198b. 

;.  A.  Performance  evaluation  of  the  embedded  secondary  task 
Preprints  of  the  1982_ Annua il_  Sclent If ic  Meeting,  Aerospace 
relation.  Aerospace  Medical  Association,  Washing'  >n ,  IX",  1982. 

k  Kimball,  K.  A.  Methodological  considerations  of  visual 
’/helicopter  pilots.  Proceedings  of  the  AOARD  Conference  on 
tesess  Workload  (A2  l).  AOAKD  CPH  21fc.  Advisory  Croup  for 
search  and  Development,  Neullly  sur  Seine,  France.  19/7. 

.i  Kimball,  K.  A.  Operator  visual  worktoad  shifts  as  a 
vehicle  stability.  Proceedings  of  the  Human  Factors  Society 
•tetlng,  pp.  7S2  7‘>6.  Human  Factors  rii-K  iety,  Santa  Monica, 

t  Kimball.  K.  A.,  f»  Diaz,  J.  J.  Measurement  of  aviator  visual 
» yid  work  load  during  helicopter  operations  Hep.  No.  7/  4.  US 
agcal  Research  Laboratory.  Ft.  Rucker.  At.,  .776. 

..Ices,  M.  A.,  I*  Kimball,  K.  A.  Visual  performance/workload  of 
-^lots  during  Inst  rumen  t  f  light ,  USAARL  Rep.  No.  78  6,  U'J  Army 
••Command,  Washington,  DC,  1978a. 


Simmons,  R.  R.,  Lees,  M.  A. ,  &  Kimball,  K.  A.  Aviator  visual  performance:  A 
comparative  study  of  a  helicopter  simulator  and  the  UH-1  helicopter.  In 
AGARD  Operational  Helicopter  Aviation  Medicine,  pp.  52.1-52.13,  AGARD- 
CP-255,  Advisory  Group  for  Aerospace  Research  and  Development,  Neuilly- 
sur-Seine,  France,  1978b. 

Simmons,  R.  R.,  Sanders,  M..  &  Kimball,  K.  A.  visual  performance:  A  method  to 
assess  workload  in  the  flight  environment.  In  B.  0.  Hartman  &  R.  R. 
McKenzie  (Eds.),  Survey  of  methods  to  assess  workload,  pp.  73-81, 

AGARD- AG- 246 .  Advisory  Group  for  Aerospace  Research  and  Development, 
Neuilly-sur-Seine,  Prance,  1979. 

Smith,  K.  VJ.  Cybernetic  theory  and  analysis  of  learning.  In  E.  A.  Bilodeau 
(Ed.).  Acquisition  of  skill.  Academic  Press,  pp.  425-482,  New  York,  1966. 

Smith,  K.  U.  Cybernetic  foundations  of  physical  behavior  science.  Quest , 

1967,  8,  26  89. 

Smith.  K.  U.,  6  Smith.  M.  F.  Cybernetic  principles  of  learning  and  educational 
design .  Holt,  Rinehart.  6  Winston,  New  York.  1966. 

Spady.  A.  A.  Jr.  Airline  pilot  scan  patterns  during  simulated  ILS  approaches, 
NASA  TP  1250.  National  Aeronautics  and  Space  Administration.  Lanqley 
Research  Center.  Hampton,  VA,  1978. 

Stern.  J.  A.,  6  Skelly,  J.  J.  The  eye  blink  and  workload  considerations. 
Proceedings  of  the  Human  Factors  Society  28th  Annual  Meeting,  1984,  2, 

942  911. 

Teic  finer .  V.  H.  Interaction  of  behavioral  and  physiological  stress  reac  tions. 
Psychological  Review,  1968,  75.  271  291. 

Tice,  J.  Army  program  integrates  personnel  training  and  weapons  design. 

Defense  News,  p.  6,  January  1986. 

Vidulich,  M.  A.,  6  Wickens,  C.  D.  Subjective  workload  assessment  and 
voluntary  control  of  effort  in  a  tracking  task.  Twentieth  Annual 
Conference  on  Manual  Control  Volume  1.  Rep.  No.  NASA  CP  2341.  pp.  57  71. 
National  Aeronaur ics  and  Space  Administration,  Moffett.  CA,  1984. 

Vidulich,  M.  A.,  6  Wickens,  C.  U.  Causes  of  dlssaciation  between  subjective 
workload  measures  and  performance:  Caveats  for  t he  use  of  subjective 
assessments.  Proceedings  of  the  Third  Symposium  on  Aviation  Psychology, 
pp.  723  230.  1985. 

Waller.  M.C.  An  investigation  of  correlations  between  pilot  scanning  behavior 
and  workload  using  stepwise  regression  analysis,  NASA  TM  X  3344.  NASA 
Langley  Research  Center,  Hampton,  VA,  1976. 

Waller,  M.C. ,  Harris  R.L.,  Sr.,  6  Salmlrs,  s.  A  study  of  parameters 

affecting  a  display  for  aircraft  instrument  landing.  Proceedings  of  the 
23rd  Annual  Meeting  of  the  Human  Factors  Society.  October  29  November  1, 
1979,  315  346,  Boston.  MA . 


Weir.  D.H.  &  Klein,  R.H.  Measurement  and  analysis  of  pilot  scanning  behavior 
during  simulated  Instrument  approaches.  Proceedings  of  the  6th  Annual 
HASA-Untverslty  Conference  on  Manual  Control.  83-108,  Vrlght-Patterson 
AP8.  1970. 

Wlckens,  C.  0.  Engineering  psychology  and  human  performance.  Columbus,  OH, 
Charles  B.  Merrill  Publishing  Company.  1984. 

widens,  C.  0. .  Mountford,  S.  J..  &  Schreiner.  W.  Multiple  resources, 

task-hemispheric  Integrity,  and  individual  differences  in  time-sharing. 
Human  factors.  1981.  23.  211-229. 

wlckens,  C.  D. .  &  Yeh,  Y.  Y.  The  disassoclat ion  between  subjective  workload 
and  performance:  A  mulitple  resource  approach.  Proceedings  of  the  Human 
Factors  Society  27th  Annual  Meeting,  1983,  l,  244-248. 

wiener.  N.  Cybernet lcs.  Wiley,  New  York,  1948. 

Wierwllle,  W.  W.,  &  Connor.  S.  A.  Evaluation  of  20  workload  measures  using  a 
psychomotor  task  in  a  moving  base  aircraft  simulator.  Human  Factors, 
1983,  25.  1-6. 

Wierwllle,  W.  W. ,  Kahiml,  M.  ,  6  Oasali,  J.  0.  Evaluation  of  16  measures  of 
mental  workload  using  a  simulated  flight  task  emphasizing  medial lonal 
activity.  Human  Factors,  1985,  27(5),  489  502. 

Williams,  1,.  J.  Cognitive  load  and  the  functional  field  >(  view.  Human 
Factors,  1982,  24(6).  683  692. 

Williams,  L.  J.  Tunnel  vision  Induced  by  a  foveal  load  manipulation. 

Human  Factors,  1985,  27,  221  227. 

Williams,  1,.  J.,  6  l.efton,  l..  A.  Processing  of  alphabetic  information 

presented  in  the  fovea  of  the  periphery:  Functional  field  of  view  and 
cognitive  workload.  Perception,  1981,  10.  645  650. 

Wilson,  <7.,  McCloskey,  K,  &  Oavis.  l.  l.inguist  ir  processing:  Physiological 
and  subjective  correlates.  Proceedings  of  the  30th  Human  Factors  Society 
Meeting.  Human  Factors  So<  iety.  Dayton,  OH,  1986. 

Wilson,  a .  F.,  O'Donnell,  K.  I>. ,  6  Wilson,  l..  Neurophysiological  measures 
of  A  10  'workload  during  simulated  low  aU  itude  missions ,  A  FAME!. 

TR  83  0003,  Human  Engineering  Division,  Wright  Patterson  AFB ,  OH,  1982. 

Wilson,  0 .  P.,  Purvis,  B.,  Skelly,  J..  Fullenkamp,  p..  6  Davis,  I. 

Phys lo log  leal  data  used  to  measure  pilot  workload  in  actual  flight  and 
simulator  conditions.  Proceedings  of  the  31st  Human  Factors  Society 
Meeting.  Human  Factors  Society.  New  York,  1987. 

Wright,  P.,  6  Kahneman,  D.  Evidence  for  alternative  strategies  of 

sentence  retention.  Quarterly  Journal  of  Experimental  Psychology.  1971, 
23.  197  213. 


A 


66 


Yeh.  Y.  Y..  &  Wickens,  C.  D.  Why  do  performance  and  subjective  workload 
measures  disassociate?  Proceedings  of  the  Human  Factors  Society  28th 
Annual  Wee ting.  1984,  1,  504-508. 

Yeh,  Y.  Y.,  &  Wlckens,  C.  D.  An  Investigation  of  the  dlsassoclatlon 

between  subjective  measures  of  mental  workload  and  performance.  BPL-TR- 
84-1/NASA-TR-84-1.  University  of  Illinois,  Engineering-Psychology  Research 
Laboratory,  Urbana-Chaapaign.  1985. 

Yolton,  R.  L.,  Wilson,  G.,  Davis,  I.,  &  McCloskey,  K.  Physiological 

correlates  of  behavioral  performance  on  the  mathematical  processing 
subtest  of  the  CTS  battery.  Proceedings  of  the  31st  Human  Pactors  Society 
Meeting.  Human  Factor?  Society,  New  York,  1987. 

Yules.  R.  B.,  Krebs.  C.  Q..  &  Gault.  F.  P.  Reticular  formation  control  of 
vestibular  systems.  Experimental  Neurology.  1966,  16,  349  358. 


67 


APPENDIX  A 


BIBLIOGRAPHY 

Aasman,  J.,  Mulder,  G.,  &  Mulder,  L.  J.  M.  (1987).  Operator  effort  and  the 
measurement  of  heart-rate  variability.  Hiaaan  Pactors.  29,  161-170. 

Ackerman,  P.  L.  (1984).  Multivariate  evaluation  of  workload,  resources,  and 
performance  in  dual  task  data.  Proceedings  of  the  Human  Pactors  Society 
28th  Annual  Meeting  (pp.  210-214).  Santa  Monica:  Human  Pactors  Society. 

Ackerman,  P.  L. ,  Schneider,  V.,  &  Wickens,  C.  D.  (1984).  Deciding  the 
existence  of  a  time  sharing  ability.  Human  Pactors.  26,  71-82. 

Ackerman,  P.  L.,  &  Wlckens,  C.  D.  (1982).  Methodology  and  the  use  of  a  dual 
and  complex-task  paradlrms  In  human  factors  research.  Proceedings  of  the 
Human  Pactors  Society  26th  Annual  Meeting  (pp.  354-3S8).  Santa  Monica: 
Human  Pactors  Society. 

Acosta,  E.  Jr.,  6  Dickman,  J.  D.  (1984).  Information  processing  In  the  visual 
periphery:  Influence  of  mental  workload.  Proceedings  of  the  Human  Factors 
Society  28th  Annual  Meeting  (pp.  737  739).  Santa  Monica:  Human  Factors 
Society . 


Acton,  W.  H.,  &  Colie,  H.  (1984).  The  effect  of  task  type  and  stimulus  pacing 
rate  on  subjective  mental  workload  ratings.  Proceedings  of  the.  IEEE  1984 
National  Aerospace  and  Electronics  Conference  (pp.  818  823).  Dayton,  OH: 
IEEE. 


Acton,  V.  H.,  6  Crabtree,  M.  S.  (1986).  Workload  assessment  techniques  in 
system  redesign.  Proceedings  of  the  IEEE  1986  National  Aerospace  and 
Electronics  Conference.  Dayton,  OH:  IEEE. 

Acton,  W.  H.,  Crabtree,  M.  S.,  Simons,  J.  C.,  Comer,  F.  E.  6  Eckel,  J.  S. 

(1983).  Quantification  of  crew  workload  imposed  by  communications  related 
tasks  In  commercial  trans{>ort  aircraft.  Proceedings  of  the  Human  Factors 
Society  27th  Annual  Meeting  (pp.  239  243).  Santa  Monica:  Human  Factors 
Society . 

Adams,  R.  J.,  6  Rich,  P.  (1977).  WNAV  waypoint  charting  effects  on  pilot 
procedures,  training  and  work  load .  Proceedings,  National  Aerospace 
Meet lng.  Washington,  U.C.:  Instutute  of  Navigation. 

Ahern,  S..  6  Beatty,  J.  (1979,  September).  Pupllla.y  responses  during 

Information  processing  vary  with  scholastic  test  scores.  Scjence,  20b. 
1289  1292. 

Alabanese.  R.  A.  (1977).  Mathemat leal  analysis  and  computer  simulation  In 

military  mission  workload  assessment.  Proceedings  of  the  AGARp  Conference 
on  Methods  to  Assess  Workload,  Conference  Proceedings  No.  216. 


68 


Alabanese,  R.  A.  (1979).  Quantitative  military  workload  analysis.  In  B.  O. 
Hartman  i  R.  E.  McKenzie  (Eds.).  Survey  of  methods  to  assess  workload. 

Albery,  W.  B.  (1988).  The  effects  of  blodynamlc  stress  on  workload  In 

human  operators  (AAMRL-TR-88-004) .  Wright-Pat terson  Air  Force  Base.  OH: 
Human  Systems  Division,  Air  Force  Systems  Command. 

Albery,  W.  B.,  Roe,  M.  M..  Goodyear.  C.  D..  McCloskey,  K.  A.  (1988).  The 

effects  of  blodynamlc  stress  on  workload  In  human  operators.  Proceedings 
of  the  Human  Factors  Society  32nd  Annual  Meeting  (pp.  1409-1413).  Santa 
Monica,  CA:  Human  Factors  Society. 

Aldrich,  T.  B.,  &  Szabo,  S.  M.  (1986).  A  methodology  for  predicting  crew 

workload  In  new  weapons  systems.  Proceedings  of  the  Human  Factors  Society 
30th  Annual  Meeting  (pp.  633-637).  Santa  Monica:  Human  Factors  Society. 

Aldrich,  T.  B.,  Szabo,  S.  M. ,  6  Blerbaum,  C.  R.  (1988).  The  development  and 
application  of  models  to  predict  operator  workload  during  system  design. 

In  G.  MacMillan  (Ed.),  Human  performance  models.  NATO  AGARD  Symposium. 

Allen,  K.  W..  Jex,  H.  R..  McRuer,  D.  T..  &  DiMarco,  R.  J.  (1975).  Alcohol 
effects  on  driving  behavior  and  performance  in  a  car  simulator.  IEEE 
Transactions  on  Systems.  Man,  and  Cybernetics.  SMC- 5 .  498  505. 

Allport,  D.  A..  Antonis.  8..  Reynolds,  p.  (1972).  On  the  division  of 

attention:  A  disproof  of  the  single  channel  hypothesis.  Quarterly  Journal 
U  Experimental  Psychology.  24,  225  235. 

Allulst,  E .  A.  6  Morgan,  B.  B..  Jr.  (1971).  Effects  of  sustained  performance 
on  time  sharing  a  three  phase  code  t ransformat ion  task  ( 3P  COTRAN). 

Pe rceptual  and  Motor  Skills,  33,  639  651. 

Anderson,  D.  B. ,  6  Chlou,  V.  C.  (19/7).  Physiological  parameters  associated 
with  extended  helicopter  f 1 Ightmiss ions:  an  assessment  of  pupi 1 lographic 
data  (Final  Rep.  USARRI.  77  21  ).  Fort  Rucker,  AI, :  U.S.  Army  Aeromed ical 
Research  Laboratory. 

Anderson,  P.  A.,  6  Toivanen,  M.  I,.  (  1970).  Effects  of  varying  levels  of 

autopilot  assistance  andworkload  on  pilot  performance  in  the  helicopter 
formation  flight  mode  (JANAIR  680610).  Washington,  D.C.:  U.S.  Office  of 
Naval  Research. 

Andreassl,  J.  1...  6  Jus/.csak,  N.  M.  (  1982).  Hemispheric  sex  differences  in 
response  to  apparently  moving  st lmul l  as  indicated  by  v l sual  evoked 
potentials  (afokw-tk  A?  mil).  Bolling  Air  Force  Base,  IX?:  Air  Force 
Office  of  Scientific  Research.  (NTls  No.  AD  A121822) 

Andreassl,  J.  L.,  &  Juszcsak,  N.  M.  (1983).  Brain  responses  and  information 
processing  IV:  Invest lqat ions  of  hemlsphe rl c  asymmetry  In  even t  related 
potentials  and  performance  during  discrimination  of  line  orientation, 
color,  shape  and  under  visual  masking  (AFOSR  TR  84  0182).  Bolling  Air 
Force  Base,  DC:  Air  Force  Office  of  Scientific  Research.  (NTIS  No.  AD 
Al 39797 ) 


69 


Angus,  R.  O. ,  &  Heslegrave,  R.  J.  (1983,  April).  The  effects  of  sleep  loss  and 
sustained  mental  work:  Implications  for  command  &  control  performance. 
Neuilly-sur-Seine,  Prance:  AOARD  Conference  Proceedings  Mo.  338  (pp. 
11.1-11.21).  Advisory  Group  for  Aerospace  Research  6  Development.  (NTIS 
MO.  AD  A139324) 

Anllker,  J.,  Finger,  H.,  &  Rlmmer,  T.  (1973,  Hay).  Entralnablllty  of  cortical 
alpha  phase  as  an  estimator  of  alertness.  Las  Vegas,  MV:  Proceedings  of 
the  1973  Annual  Scientific  Meeting  of  the  Aerospace  Hedlcal  Association 
(pp.  131-132),  Aerospace  Medical  Association. 

Antln,  J.  P.,  &  Wierwille,  V.  W.  (1984).  Instantaneous  measures  of  mental 
workload:  An  initial  Investigation.  Proceedings  of  the  Human  Factors 
Society  28th  Annual  Meeting  (pp.  6-10).  Santa  Monica:  Human  Factors 
Society. 

Arbak,  C.  J.,  Shew,  R.  L. ,  &  Simons,  J.  C.  (1984).  The  use  of  reflective  SWAT 
for  workload  assessment.  Proceedings  of  the  Human  Factors  Society  28th 
Annual  Meeting  (pp.  9S9-962).  Santa  Monica:  Human  Pactors  Society. 

Armstrong  Aerospace  Medical  Research  Laboratory  (1987).  subject lve  workload 
assessment  technique  (SWAT):  A  user*s  guide.  Dayton.  OH:  AAMKL,  Wright 
Patterson  Air  Force  Base. 

Armstrong,  G.  C.  ,  Sams,  D.  D..  McDowell,  j.  w.  ,  f>  Winter,  F.  J.,  Jr.  (1975). 
Pilot  factors  for  helicopter  pre  experimental  phase  (IFC  TR  M  2). 

Randolph  AFB,  TX:  USAF  Instrument  Flight  Center. 

Aslala,  C.  F. ,  lx>y,  S.  L.,  6  Quinn,  T.  J.  (1969).  Digital  simulation  model  for 
fighter  pilot  workload  (MDC  A0058).  St.  Louis,  MO:  McDonnell  Ain  raft 
Company . 

Aslala,  C.  F.,  Ix>y.  3.  L. ,  Welde,  W.  1..,  Bull,  K .  F.  ,  6  Fitzgerald,  J.  A. 

(1981).  Pi  lot  workload  assessment  (afamki,  tk  80  109).  Wright  Patterson 
AFB,  OH:  Air  Force  Aerospace  Medical  Research  Laboratory.  (DTIC  No. 

AD  BOSS  801 ) . 

Auffret,  R.  (Ed.).  <197/,  April).  Studies  on  pilot  workload.  Koirt,  German/: 
AGARD  Conference  Proceedings  No.  217.  Advisory  Group  for  Aerospace 
Research  6  Development. 

Aunon,  J.  1.,  Kant owl tz.  B.  II..  McGlllem,  C.  D..  6  Plonskl,  M.  p.  (1987, 

September).  Electromagnetic  metrics  of  mental  workload  (AFOUR  8b  0311). 
Bolling  Air  Force  Base,  DC:  Air  Force  Office  of  Scientific  Research. 

Bahlll,  A.  T. ,  6  Stark,  L.  (1975).  Overlapping  saccades  and  glissades  are 
produced  by  fatigue  in  the  saccadic  eye  movement  system.  Experimental 
Neurology ,  48,  93  106. 

Bahrlck,  II.  P.,  Noble,  M. ,  6  Fitts,  P.  M.  (1954).  Extra  task  performance  as  a 
measure  of  learning  a  primary  task.  Journal  of  Experimental  Psychology, 

48.  298  302. 


70 


Balnbrldge,  L.  (1978).  Porgotton  alternatives  in  skill  and  work-load. 
ergonomics.  21.  169-185. 

Barnes.  C.  R.  (1982,  July).  A  procedure  for  the  analysis  of  nystagmus  and 
other  eye  movements.  Aviation,  Space,  and  environmental  Medicine.  53(7), 
676-682. 

Barnes,  J.  A.  (1977).  Use  of  eye-movement  measures  to  establish  design 
parameters  for  helicopter  instrument  panels.  Proceedings  of  the  AGARD 
Conference  on  Methods  to  Assess  Workload  (AGARD  CPP-216). 

Neuilly-sur-Seine,  Prance:  Advisory  Group  for  Aerospace  Research  and 
Development . 

Baron,  S.  6  Levtson,  W.  H.  (1975).  An  optimal  control  display  for  analyzing 
the  effects  of  display  parameters  on  performance  and  workload  In  manual 
flight  control.  TREE  Transactions  on  Systems.  Man,  and  Cybernetics, 

SMC  5,  423  430. 

Baron,  S.  6  Levlson.  w.  H.  (1977).  Display  analysis  using  the  optimal 
control  model  of  the  human  operator.  Human  Pactors.  19,  437-457. 

Barr,  C.  C.,  Schulthels,  l..  W.,  &  Robinson,  D.  A.  (1976).  Voluntary,  non 
visual  control  of  the  human  vest lbulo  ocular  reflex.  Acta  Otolaryn 
go log  lea,  81,  365-375. 

Bate,  A.  J.,  6  Self,  M.  0.  (1968).  Effects  of  simulated  task  loading  on 

side  looking  radar  target  recognition  (AMRI.-TK  67-141).  Wright  Patterson 
APB,  OH:  Aerospace  Medical  Research  laboratory. 

Bateman,  R.  P.  (1979).  An  heuristic  approach  to  work  analysis.  Proceedings 
of  the  23rd  Annual  Meeting  of  the  Human  Pactors  Society  (pp.  554  55  0. 

Santa  Monica,  CA:  Human  Pactors  Society. 

Bateman,  R.  P.,  Aclon,  W.  H.,  &  Crabtree.  M.  S.  (1984).  Workload  and 
performance:  Orthogonal  measures.  Proceedings  of  the  Human  Factors 
Society 28th  Annual  Meeting  (pp.  678  679).  Santa  Monica:  Human  Factors 
Soc iety . 

Battlste,  V.,  6  Bortolussi,  M.  (1988).  Transport  pilot  workload:  A  comparison 
of  two  subject ive  techniques.  Proceedings  of  the  Human  Factors  Society 
32_nd  Annual  Meeting  (pp.  150  154).  Santa  Monica,  (.'A:  Human  Pactors  Society. 

Battlste,  V.,  6  Hart,  S.  G.  (1985).  Predicted  versus  experienced  workload  and 
performance  on  a  supervisory  control  task.  Proceedings  of  the  Third 
Symposium  on  Aviation  Psychology,  pp.  255-262. 

Baty,  D.  I..  (1971).  Human  transformation  rates  during  one  to  four  axis 
tracking  with  a  concurrent  audio  task.  Proceedings  of  the  7th  Annual 
NASA-Unlverslty  Conference  on  Manual  Control  (pp.  293  306). 

Bauer,  L.  O. ,  Goldstein.  R.,  6  Stern,  J.  A.  (1987).  Effects  of  Information 
processing  demands  ext  physiological  response  patterns.  Human  Factors, 
29(2),  211  234. 


71 


Beattie,  0.  V.  (1981).  A  further  Investigation  of  the  cognitive  Interference 
hypothesis  of  gaze  patterns  during  conversation.  British  Journal  of 
Social  Psychology.  20,  243-248. 

Beattie,  J.,  Greenberg,  A.,  Delbler,  W.  P.,  &  O'Hanlon.  J.  P.  (1974).  Operant 
control  of  occipital  theta  rhythm  affects  performance  in  a  radar 
monitoring  task.  Science.  183.  871-873. 

Beatty,  J.  (1979).  Pupillooetrlc  methods  of  workload  evaluation:  present 
status  and  future  possibilities.  In  B.O.  Hartman  and  R.  E.  McKenzie 
(Eds.),  Survey  of  methods  to  assess  workload  { AGARO- AG-246 ) . 

Beatty,  J.  (1982).  Task-evoked  pupillary  responses,  processing  load,  and  the 
structure  of  processing  resources.  Psychological  Bulletin.  (U(2).  276-292 

Beatty,  J . ,  &  Wagoner,  D.  L.  (1978).  Pupil lometrlc  signes  of  brain  activation 
vary  with  level  of  cognitive  processing.  Science.  199,  1716-1718. 

Bell,  P.  A.  (1978).  Effects  of  noise  and  heat  stress  on  primary  and 
subsidiary  task  performance.  Human  Factors.  20.  749  752. 

Bellenkes,  A.  H.  (1984).  Dual  task  timesharing  using  a  projected  attitude 

display  (Malcolm  Horizon)  (NAMRL  TR  1310).  Pensacola,  FL:  Naval  Aerospace 
Medical  Research  Laboratory .  (OTIC  No.  AD  A150  789). 

Benel,  K.  A.,  Coles,  M.  G.  H..  Bertel,  D.  C.  R .  (1979).  Klee t roderma 1 
lability  and  individual  differences  In  slmulataneous  monitoring  and 
tracking.  Proceedings  of  the  23rd  Annual  Meeting  of  the  Human  Factors 
Society.  Santa  Monica,  Human  Factors  Society. 

Benson.  A.  J.,  Huddleston,  J.  H.  K.,  f>  Rolfe.  .  M.  (196b).  A  psycho 

physiological  study  of  compensatory  tracking  on  a  digital  display.  Human 
Factors.  7,  457  472. 

Berg,  S.  L..  *■  Sheridan,  T.  H.  (1984).  Measuring  workload  differences  between 
short  term  memory  and  long  term  m«?ir<<ry  scenarios  in  a  simulated  flight 
environment.  Proceedings  of  the  20th  Annual  Conference  on  Manuai  Control, 
NASA  CP  2341,  l.  397  416. 

Berg,  5.  t. .,  6  Sheridan,  T.  H.  (1985).  Kf feet .  of  time  span  and  task  load  on 
pljot  mental  workload  (NASA  CK  17/388).  Wash Inqton .  D.C.:  National 
Aeronautics  and  Space  Administration. 

Berg,  S.  L.,  fc  Sheridan,  T.  B.  (1986).  The  Impact  of  physical  and  mental  task 
on  pilot  mental  workload.  Proceedings  of  the  2lst‘  Annual  Conference  on 
Manual  Control.  NASA  CP  2428,  6.1  6.26. 

Bergeron,  H,  P.  (1968).  Pilot  response  In  combined  control  tasks.  Human 
Factors.  10,  277  282. 

Bergstroem,  B.,  6  Arnberg,  P.  Heart  rate  and  performance  In  manual  missile 
guidance.  Perceptual  and  Motor  Skills,  32,  352  354. 


Beringer,  D.  B.  (1979).  The  design  and  evaluation  of  complex  systems: 

Application  to  a  man-machine  Interface  for  aerial  navigation.  Proceedings 
of  the  Human  Factors  Socertv  23rd  Annual  Meeting  (pp.  75-79).  Santa 
Monica:  Human  Factors  Society. 

Bermudez,  J.  M. ,  Harris,  D.  A.,  &  Schwank,  J.  c.  H.  (1979).  Peripheral 

vision  and  tracking  performance  under  stress.  Proceedings  of  the  Human 
Pactors  Society  23rd  Annual  Meeting  (pp.  402-406).  Santa  Monica:  Human 
Pactors  Society. 

Beyer,  R.  (1977).  A  study  of  pilot's  workload  In  helicopter  operation 

under  simulated  1MC  employing  a  forward  looking  sensor.  Proceedings  of 
the  AGARD  Conference  on  Studies  on  Pilot  Workload  (B6.l-B6.10) 

(AGARD  CPP-217). 

Biers,  D.  W. ,  &  Mas  line,  P.  (1987).  Alternative  approaches  to  analyzing 

SWAT  data.  Proceedings  of  the  Human  Factors  Society  3lst  Annual  Meeting 
(pp.  63-66).  Santa  Monica,  CA:  Human  Factors  Society. 

Blferno,  M.  A.  (1985).  Mental  workload  measurement:  Event-related  potentials 
and  ratings  of  workload  and  fatigue  (NASA  CR  177354).  Washington,  D.C. : 
National  Aerronautics  and  Space  Administration. 

Blferno,  M.  A.,  6  Boucek,  G.,  Jr.  (  1987,  June).  Proceedings  of  the  wo rjc shop 
on  the  assessment  of  crew  workload  measurement  methods^  techniques  and 
procedures:  Volume  I,  Preliminary  selection  of  measures  (AKWAI.  TK  87  3043, 
Vol .  I).  Wright  Patterson  Air  Force  Base,  OH:  Flight  Dynamic*  Laboratory. 
Air  Force  Systems  Command. 

Biferno,  M.  A.,  6  Boucek,  G.,  Jr.  (1987,  June).  Proceedings  of  the  workshop 
on  the  assessment  of  crew  workload  measurement  methods,  techniques  and 
procedures:  Volume  11,  Library  references  (AFWAl.  TK  87  3041.  Vol.  I  I). 
Wright  Patterson  Air  Force  Base,  OH:  Flight  Dynamics  l.atrorat  nr  y ,  Air  Force 
Systems  Command .  (NT IS  No.  AD  A191209) 

Bisseret,  A.  (1971).  Analysis  of  mental  processes  involved  in  alt  traffic 
control.  Ergonomics,  14,  565  570. 

Bittner,  A.  C.  ,  Jr.,  Bulger.  J.,  Zaklad,  A.,  I. inton,  P..  Dirk,  A.,  t.ysaght  , 

K.,  Wherry,  K.  J.  Jr.,  Dennison,  T..  6  Herman,  FI.  (1187).  Operator 
•workload  (OWL)  assessment  program  for  the  Army :  Validation  and  analysis 
plans  for  three  systems  (ATHS,  AQUILA,  LOS  F(H>)  (DTK  2075  3is).  Willow 
Grove,  PA:  Analytics,  Inc. 

Bittner,  A.  C.,  Jr.,  Wlerwllle,  W.  W.  ,  Christ,  R.  K .  ,  1  inton.  P.  M.  ,  f.  Glen. 

K.  A.  III.  (1987).  Operator  workload  (OWL)  progaram  for  army  systems: 
overview  and  progress.  Proceedings  of  the  Human  Factors  Society  31st 
Annual  Meeting.  Santa  Monica,  CA:  The  Human  Factors  Society. 

Beare,  A.  N.,  Biersner,  R.  J.,  Bondi,  K.  R.,  6  Naltoh,  P.  (1981).  Work  and 
rest  on  nuclear  submarines  (Rep.  No.  946,  pp.  1  22).  Groton,  CT :  Naval 
Submarine  Medical  Research  Laboratory. 


n 


Blackburn,  M.  R.,  &  Lewis,  G.  VI.  (1986,  March).  Neuroelectric  prediction  of 
naval  aviation  training  attrition:  EEC  Indices  of  anxiety  (HFOSL  Tech. 

Note  71-86-03).  San  Diego,  CA:  Hunan  Pactors  6  Organizational  Systems 
Laboratory,  Navy  Personnel  Research  and  Development  Command. 

Bloem,  K.  A.  &  Damos,  D.  L.  (1985).  Individual  differences  in  secondary  task 
performance  and  subjective  estimation  of  workload.  Psychological  Reports. 
56,  311-322. 

Blyx,  A.  S.,  Stromme,  S.  B.,  &  Ursln,  H.  (1974).  Additional  heart  ratean 

indicator  of  psychological  activation.  Aerospace  Medicine,  45,  1219-1222. 

Boff,  K.,  Kaufman,  L.,  &  Thomas.  J.  (Eds.),  Handbook  of  perception  and  human 
performance.  New  York:  V/lley. 

Bonnet,  C.  (1967).  The  perceived  brightness  ol  a  t ticketing  moving  spot. 
Psychonomlc  Science,  8(12),  503-504. 

Borg,  G.  (1978).  Subjective  aspects  of  physical  and  mental  load.  Ergonomics , 
21,  215-220. 

Bortolussi,  M.,  Hart,  S.  G.,  6  Shively,  R.  J.  (1987).  Measuring  momemt  to 
moment  pilot  workload  using  synchronous  presentations  of  secondary  tasks 
in  a  motion  base  trainer.  Proceedings  of  the  Fourth  Tntornar lonal 
Symposium  on  Aviation  Psychology  (pp.  651  657).  rolu"bus.  OH:  Ohio  state 
University . 

Bortolussi,  M.  K.,  Karitowltz,  H.  H,.  6  Hart,  S.  G.  (1985).  Measuring  pilot 
workload  in  a  motion  base  trainer:  A  comparison  of  four  techniques. 
Proceedings  of  the  Third  Symposium  on  Aviation  Psychology .  ( pp.  761  270). 
Columbus,  OH:  Ohio  State  University. 

Bowser,  D.  K.  (1976  ).  Limiting  flight  control  systems.  In  AGARii  Conference 
Proceedings,  Stall/Spin  Problems  of  Military  Aircraft  (11.1  11.12)  (AGAKU 
A0 29  071). 

Boyce,  p.  p.  (1974).  Sinus  a t r by t hm  i  a  as  a  measure  ,t  -  •  • : ,  t  - » 1  1  el. 

Ergonomics,  17,  1/7  183. 

Boyd,  S.  P.  (  198  J)  .  Assessing  tin;  validity  <>i  SWA  i  as  «  *"ikii  id  -ei  ,ut  er.  ent 
technique.  Proceedings  of  th<?  Human  Factors  Scvlety  7/’h  Annual  Meeting 
(pp.  124  128).  Santa  Monica:  Human  Factors  So<  iety. 

Boylan,  K .  J.  (  1974).  A  review  of  crew  systems  analytic  method:.  (Report  No. 
0180  17525  1).  Seattle,  WA:  Boeing  Aerospace  company . 

Boy lan.  R.  J.  (1974).  InJ roduct ion  to  Boeing  operator  workload  and  workspace 
evaluation  models.  (Report  No.  1)180  17526  l).  Seattle,  WA:  Boeing 
Aerospace  Company. 

Bradshaw,  J.  L.  (1968).  t.oad  and  pupillary  changes  in  cont tnnous  processing 
tasks.  British  .Journal  of  Psychology,  59,  265  271. 


Bradshaw,  J.  L.  (1968).  Pupillary  changes  and  reaction  time  with  varied 
stimulus  uncertainty.  Psvchonomlc  Science,  13(2),  69-70. 

Bradshaw,  J.  L.  (1969).  Background  light  Intensity  and  the  pupillary  response 
in  a  reaction  time  task.  Psychonomlc  Science.  1_4 ( 6 ) ,  271-272. 

Brandels,  0.,  &  Lehman,  D.  (1986).  Event-related  potentials  of  the  brain  and 
cognitive  processes:  Approaches  and  applications.  Neuropsychollgla,  24 , 
151-168. 

Braune,  R.,  &  Wickens,  C.  D.  (1983).  individual  differences  and  age-related 
changes  In  time  sharing  ability  of  aviators.  Proceedings  of  the  Human 
Factors  Society  27th  Annual  Meeting  <pp.  117-121).  Santa  Monica:  Human 
Factors  Society. 

Brenner,  M.,  Branscomb,  H.  M.,  &  Schwartz,  G.  E.  (1979).  Psychological  stress 
evaluator  two  tests  of  a  vocal  measure.  Psychophysiology,. 16,  361-356. 

Brlctson,  C.  A.  (1974).  Pilot  landing  performance  under  high  workload 
conditions  (Contract  N00014  73  C  0063).  l.a  Jolla,  CA:  Dunlap  and 
Associates . 

Brlctson,  C.  A.  (1974).  Pilot  landing  performance  under  high  'workload 

conditions.  Proceed  1 ngs  of  the  AGARD  Conference  on  Simulation  and  Study 
of  High  Workload  Operations  ( A 7 . 1  A7.10)  (AGARD  op  146). 

Brlctson,  C.  A.  (1977).  Methods  to  assess  pilot  workload  and  other  temporal 
Indicators  of  pilot  performance  effectiveness.  Proceedings  o(  AGARD 
Conference^  on  Studies  on  Pilot  Workload  ( B9 . 1  B9.7)  (AGARD  cpp  717). 

Brlctson.  C.  A.,  6  Clavarelll,  A.  p.  (1979).  Aircrew  per  format.  •  research 
opportunities  using  the  air  co-hat  maneuver  1  rig  range  ( ACMR  :  In  B.  0. 

Hartman  6  R.  K.  McKen/ie  (Kds.),  Survey  •>(  Methods  to  Assess  Workload 
(AGARD  AG  246)  ( pp . ,  111  111). 

Mr  ict  son,  C.  A.,  McHugh,  W.,  f,  Maitoh,  P.  (l'*/4).  Prediction  of  pilot 

performance:  Biochemical  arid  sleep  mood  ot  relates  under  high  work. .>  el 
rrond  1 1  Ions .  Proceedings  of  t  tie  AGARD  Conference  on  Simulation  and  study 
of  High  Workload  Operations  (AGARD  >‘P  14‘)  fpp.  AI3.1  Alt.  10). 

Bringham,  K.  R.  (19/4).  COPTKC  A  controller  over lo id  prediction  technique 

(IIUSAT  Memo  *67).  t.oughhor  ougti ,  England:  University  of  Technology,  Human 
Sciences  and  Advanced  Technology  Research  Group. 

Bromberger,  K.  A.  (1976).  I  .AMPS  simulations:  VI.  Pilot  performance  In  the 
I  .AMPS  simulator  (NADC  76191  40).  Warminster,  PA:  Naval  Ait  Development 
Center . 

Brown,  I.  D.  (  1978).  Dual  task  methods  of  assessing  wot  k  load.  Ergonomics , 
21.  221  724. 


Brown,  X.  u.  (1969).  Criticisms  of  time-sharing 
measurement  of  perceptual-motor  difficulty. 
Internat lonal  Congress  of  Applied  Psychology 
Swets  &  Zeitllnger. 


techniques  for  the 
Proceedings  of  the  16th 
(pp.  322-328).  Amsterdam: 


Brown,  I.D.,  6  Poulton,  E.  C.  (1961).  Measuring  the  spare  mental  capacity  of 
car  drivers  by  a  subsidiary  task.  Ergonomics ,  4(1),  35-40. 


Buckley.  K.  P.,  6  O'Conner,  V.  F.  (1979).  Individual  and  system  performance 
indices  for  the  air  traffic  control  system.  In  B.  0.  Hartman  &  R.  E. 
McKen/.ie  (Eds.)  Survey  of  Methods  to  Assess  Workload  ( AG  AH  L)  AG  246)  (pp. 
136  136). 


Bur  ford ,  C.  t..,  Ramsey,  J.  L) .  ,  Tayyarl,  F.  ,  bee,  C.  H.,  6  Stepp,  K.  G.  (  1984). 
A  method  for  systematic  workload  estimation  (GWE) .  Proceedings  of  the 
Human  Factors  Society  28th  Annual  Meeting  (pp.  997  999).  Santa  Monica: 
Human  Factors  Society. 

Burke,  J.  k.  (19/3).  Use  of  Eye Mark/Gony  Vldeocorder  System  and  related  data 
reduction  (VSI>  Report  2  S7110/3K  3107).  Dallas  'I'X :  I  .TV  Aerospace,  Vought 
Gy  s !  '•:<  s  Division. 


e,  M  . 

w. 

(  1 

9  /  9  )  . 

An  inve 

st  igat  ion  . >f 

Vi 

Mid  1 / t 

a<  nidi 

mu  i  t  i 

rruxla  1 

:nt  .it 

1 

.  »n 

pp,. 

“S 

sing  us 

. lng  dual  cro:; 

s 

adapt  t 

Ve  ,  -  i 

t  i  c  a  1 

t  r  a,  -k  1  ng  i 

h  isks 

I,: 

1  '1 

i 

Rep.  U 

r 

■Jo  .  3  )  . 

Co  1 u-hus .  oh : 

The 

"t  i 

I'e  111, 

i  v ■■  r  ■  i  t  y 

A  •'  :  i  -  • 

■  r . 

1  ■  - 

,  i..,: 

’  i 

V  Sit,  If 

a  t  of  y  . 

“  .  M 

•  •  , 

K  .  D  .  , 

6  Jagac  i  risk  :  , 

K 

.  .1 .  1 

’  *  P  '  ' 

Mu  1  ' 

:  >•!  I ; 

1  ' :  ;  •  .  r 

e  .  ,  ’ 

i  ’  . 

■  mg  h, 

it  visual  w*  >[  k 

In 

•  1  *  •  , .  ' 

1  *  *  ■  . 

U  ]•  ,no 

-is:.,  3  2' 

10). 

i  i  i 

k 

;  ^ 

M). 

'tew  wor  k  1 .  >ad 

t  •• 

.  till, >]. 

*  ii  f  ‘ * v 

•  i  r  i 

;  pis?:  ie- 

. ... 

' 

• 

•  •  , » 

*•  i 

i  1  Mem 

crandu  "  A K t- 1 . 

v  /  h 

;  f-  .u 

W  r 

r  '  I  d'  t 

’  U.  •!, 

‘j  : 

.  ;v. r 

;,Y 

ria~  i>  > 

i .at>‘ >r  a t  or  y  . 

■  •  ‘  i  j  j 

l. . 

A. 

M.  Hr  ide 

,  .  K  .  (  1  984 

)  . 

A  , 

i  *  * 

'  i  ! 

•  V  •  *  •  *  “  * 

,r 

*  ■ :  ¥  , ' 

« *  . 

!**•.: 

■jr. 

and  an 

ia  lysis.  Proc 

!  ing  . 

• 

5 ;  * '  r. 

!  r  ■  1  r  ■ 

■  .»  '  *  •  * 

'  t,  /> 

rrn. 

.1  1 

i  n 

i  t  PI*  - 

t.  3  66  ).  '.an' 

1 

M.  ,n  i  ■ 

i  ;  i  ;  '  i 

•  i 

’  y  ■ 

v  . 

'W.»? 

!  ;  *• 

r  .  !  i .  . 

i.,  >ver  i  rig  .  p  .  , 

Her  r 

1  .  .  •  * 

■si.  1  .  . 

j'!  : 

A 

. '  i  r  v 

<‘Y 

>ape 

rat  l< ,ri,i  1  p t .  ,t, 

1  '■ 

•  A  •  i  r 

m  f  1 

i  . . . 

.i  «T  i 

A 

V  t*. .  - 

•H  : 

A  i  1  R- 

■  t  ■  e  vr  1  gtit  A<- 

f  ■  * 

SI  . ' 

i  i v 

i ? 

:  •  . .  s : 

:  s 

:  /• ;  n 

/ 1 

1 ,  H 

.  J  . 

h 

'  M|»* 

r  , 

A  .  c. 

Jr  .  ,  Hill, 

.  1 

1 J  .  .  s  i ,  ;  a  !  , 

A  ! 

6  ctu  ;  st 

.  R  .  r. 

i  <h(‘ ) 

ti*  * 

i  *  i  «  >«i 

\ 

»1V  t  vt  *1  t  i‘r.i  ► 

\  f' 

ly  \*\\ 

'  )  V 

.  ■  V  i  .  t  •  * 

■ HPV i  s> 

If . e 

<1  i  n 

•  »f  1 

ht* 

Human 

Fa,  tor  s  s,  „  ■  1  e 

f-  Y 

i  ’r »*  1 

Ai  .tnia  1 

Y.u-t  1 

ng  (pp. 

111*.  1 

l  4'* 

;  . 

’.Hill 

f  i 

Moni<  a 

,  <  A :  Human  1- 

T  »  »t  .  •. 

:,•!  > 

•  n  i  •  . 

V  . 

'  1 

'«  /  U  1  . 

'spec  tl 

p.C  t  <•  t  ns  and 

I  *  {  *'W 

w*  •  ?  V 

i  j .  ; 

',B  .  p 

i  r  •  -  at : 

and  R  . 

K  . 

y 

K.-fi/ 

i  «• 

(  Eds  .  ) 

Survey  Me 

t  h 

.wju  f. 

•  A . . 

,  W  >  r  V 

ioad 

AGARD 

A', 

/ 

4*.  )  ' 

PP 

.  US  1 

77  !  . 

Cannings,  R.,  Borland,  R.  G.,  Hill.  L.  E.,  &  Nicholson,  A.  N.  (1977).  Pitch 
and  format  analysis  of  the  voice  in  the  investigation  of  pilot  workload. 
Proceedings  of  the  AGARD  Conference  on  Methlsds  to  Assess  Workload 
(AGARD-CPP-216)  (pp.  A5.1~A5.10) . 

Caplan,  R.  D.,  &  Jones,  K.  V.  (1975).  Effects  of  work  load,  role  ambiguity, 
and  type  A  personality  on  anxiety,  depression,  and  heart  rate.  Journal  of 
Applied  Psychology.  60,  713-719. 

Casali,  J.  G.,  &  Vierwille,  V.  V.  (1982).  A  sensitivity/intrusion 

comparison  of  mental  workload  estimation  techniques  using  a  flight  task 
emphasizing  perceptual  piloting  activities.  Proceedings  of  the  1982  IEEE 
International  Conference  on  Cybernetics  and  Society,  pp.  598-602. 

Casali,  J.  G.,  &  Vierwille,  V.  V.  (1983).  A  comparison  of  rating  scale, 
secondary  task,  physiological  and  primary  task  workload  estimation 
techniques  in  a  simulated  flight  task  emphasizing  commuri icat Ions  load. 
Human  Factors.  25(6),  623  641. 

Casali,  J.  G.,  6  Vierwille,  V.  V.  (1984).  On  the  measurement  of  pilot 

perceptual  workload:  A  comparison  of  assessment  techniques  addressing 
sons 1 1 iv  1  ty  and  intrusion  issues.  Ergonomics,  27(  10),  1033  1050. 

Casey,  5.  M .  ,  Hreitmaler,  V.  A.,  (.  Mason,  W.  K.  (1977).  Cerebral  activation 
arid  the  placement  of  visual  displays  (NADS'  //24/  40'.  Warminster,  PA :  US 
Naval  Air  Development  Center. 

Casper,  P .  A.,  Shively.  K .  J.,  6  Hart.  S.  G.  (178/).  Decision  support  for 
workload  assessment:  Introducing  W<‘  (•iki.dk.  Proceedings  of  the  Human 
Factors  Society  31st  Annual  Meeting.  Santa  Moni.  i:  Human  Factors  Society. 

<  ‘as  per  ,  P .  A  .  ,  Shively,  H  .  J  .  ,  f»  Hart,  s  .  '  • .  (178*,'.  Workload  onsu  1 1  an*  : 

A  microprocessor  based  system  t<u  *  mg  work!  „id  assessment 

procedure:,.  Proceedings  of  t  ti»-  1988  IKFK  Int  erriat  iona  1  Conference  on 
Systems,  Man,  and  Cybernetics,  2,  1('54  ih'  7 

Cat  lei  t  ,  « .  (,.  (  1973).  Application  of  information  theory  corns  pts  to  study 
work  complex  versus  operator  act  ion  time  f'.r.AM*'  1T<‘  ,’  /  t  08).  Red  Rivet 
Army  Depot  ,  Texarkan.  TX  :  USAMC  ! :» »  <*r  n  .raining  •'enter. 

1  ava  111,  1 1 .  (19//).  bit.,  tele  time  modeling  of  t. .*.»•,  ,  t  i  .,r,  t  p  1  an*-  p  :  lot 

behavior  workloads  daring  landing.  Pt.>.  ceding.  .  d  r  !.*•  13th  Annual 
NASA  University  Conf  <*r  ern  <*  on  Manual  Control  (p*>.  ).-M  t.'8  >  . 

t'eder  ,  A.  (1977).  Driver's  eye  movements  as  t.-lated  t  • .  attention  in  simulate! 
traffic  flow  t ond i t ions .  Human  Factors.  19.  S/1  SHI. 

Chapman,  R.  M.  (1979).  Connot at l ve  meaning  and  averaged  evoked  potentials. 

In  H.  Hegleiter  (  Fd  .  )  ,  Evoked  brain  potentials  an<i  behavior.  New  York. 

P  1  etui's . 

Charlton,  S.  r;.  (198S).  Hetiavlor  analysis:  A  t ,  .  1  for  test  and  evaluation. 

Proceedings  of  the  Human  Factors  29th  Annual  Meeting  (pp.  188  197).  Sant  a 
Monica:  Human  Fa*  tors  Sf*  i »•  t  y  . 


Chechile,  R.  A.,  &  Sadoski,  D.  H.  (1983).  The  effects  of  cuing  In  time- 
shared  tasks.  Human  Factors.  25.  371-377. 

Childress,  M.  E.  (1983).  Subjective  scales  for  workload  evaluation: 

Critical  aspects  and  new  directions  for  research.  Proceedings  of  the  19th 
Annual  Conference  on  Manual  Control,  pp.  1-2. 

Childress,  M.  E.,  Hart,  S.  G.,  &  Bortolussi,  M.  R.  (1982).  The  reliability  and 
validity  of  flight  task  workload  ratings.  Proceedings  of  the  Human 
Factors  Society  26th  Annual  Meeting  (pp.  319-323).  Santa  Monica:  Human 
Factors  Society. 

Childs,  J.  M.  (1979).  The  development  of  object iv«.  inflight  performance 
assessment  procedures.  Proceedings  of  the  Human  Factors  Society  23rd 
Annual  Meeting  (pp.  329-333). 

Chiles,  w.  o.  (1977).  Objective  methods  for  developing  indices  of  pilot 
workload  (FAA  AM  77-15).  Oklahoma  City,  Oklahoma:  Federal  Aviation 
Administration,  Civil  Aeromedtcal  Institute. 

Chiles,  W.  D.  (1978).  Objective  methods.  In  A.  H.  Roscoe  (Ed.)  Assessing 
Pi  lot  Work  load  (AGAHD- AG  233) .  Neullly  sur  Seine,  France:  Advisory  Group 
for  Aerospace  Research  and  Development.  (AD  A051  587/ 

Chiles,  W.  [).,  ft  Alluisi,  K.  A.  (1979).  on  the  :-{>>■'  i  t  i /m  '  l  on  of  operator 
or  occupational  -wot  k  load  with  performance  measurement  methods.  Human 
Factors.  21.  515  528 . 

Chiles,  W.  o.  .  HI  1  is.  G.  A.,  f,  MoM/oe .  A.  H.  (1978;.  Assessing  pilot 

workload  (AGAKD  AG  233).  thru  illy  Gut  Seine,  Fiance;  \'<irth  Atlantic  Treaty 
Organization  Advisory  Group  for  Aerospace  Research  and  Development.  (DTK: 
No.  AD  A05 1  58/) 

Chiles,  W.  D..  .tenri  i  nq  s ,  A.  K.,  6  Alluisi,  K.  A.  (1979).  Measurement  arid 
scaling  >>f  workload  in  complex  per  f  nrmari<  e .  Avtat  to'  .  Space,  arid 
Environmental  Medicine.  50,  3  76  381. 


Chiles,  V.  D.,  ft  Alltisi,  E .  A .  (19/9).  on  th<>  ;l  i,  m  .  ,f  operator  >t 

occupat  li  xi<i  l  workload  with  per  t  or  imh.  ,•  -isi  .ur  ■•-ent  -  •  -  *  t  ■  >-!■..  Human 
Far  tors.  2 1 .  515  528. 

Chiles,  W .  D .  ,  .Jennings,  A  .  K  .  .  ft  Alluisi,  K  .  A  .  it/*;.  Me  a.  -  err  r  ad 

scaling  of  wr>rkload  in  (<*T.plex  performance.  Aviation.  Spa-e,  and 
Environmental  Medicine,  50(4),  376  381. 

chu.  Y.,  6  Rouse,  W.  H.  (19/7).  Optimal  adaptive  alio-  a’  '.on  <  >  t  decision 
making  responsibility  between  human  and  computer  in  multi  task 
situations.  Proceedings  of  the  1977  Internal  l.  trial  Con!  erence  on 
cybernetics  and  Society  (pp.  188  175). 

Claverelll.  A.  P.,  ft  Bill  t  son.  C.  A.  (  1978).  Air  combat  maneuvering  range 
(ACME):  Has  operational  performance  measurer  ent  enter  e<1  a  golden  age? 

Pr<  ci'i'ii  tngs  of  the  Human  Factors  Society  22nd  Annual  Meeting  ( pp . 

365  768).  Santa  Monica:  Human  Fa1  tors  So<  iety. 


Clark,  D.  A. ,  Arnold,  E.  L.,  Foulds,  E.  L. ,  Jr.,  Brown,  D.  M. ,  Eastmead,  D.  R., 
&  Parry,  E.  M.  (1975).  serum  urate  and  cholesterol  levels  In  Air  Force 
academy  cadets.  Aviation,  Space  and  Environmental  Medicine.  46,  1044-1048. 

Clark,  W.  E.,  Jr.,  &  Armstrong,  G.  C.  (1977).  Three-cue  helicopter  flight 
director  evaluation  (1FC  TR  77-3).  Randolph  APB,  TX:  USAF  Instrument 
Flight  Center. 

Clement,  V.  F.  (1976).  Investigating  the  use  of  a  moving  map  display  and  a 
horizontal  situation  Indicator  In  simulated  povered- life  short-haul 
operations.  Proceedings  of  the  12th  Annual  NASA-Unlverslty  Conference  on 
Manual  Control  (NASA-TMX- 73170)  (pp.  201-224). 

Clement,  W.  P.  (1978).  Annotated  bibliography  of  procedures  which  assess 

primary  task  performance  In  some  manner  as  the  basic  element  of  a  workload 
measurement  procedure  (Technical  Report  No.  1104-2).  Hawthorne,  CA: 

Systems  Technology,  Inc. 

Clement,  W.  F. ,  Hofmann,  L.  G..  6  Graham,  D.  (1973).  A  direct  procedure  for 
scanning  workload  with  a  flight  director.  Proceedings  of  the  IEEE 
Cybernetics  and  Society  International  Conference  (pp.  38-43). 

Clement,  W.  F.  ,  McRuer,  D.  T.  ,  (.  Klein,  K.  H.  (  1972).  Systematic  manual 

control  display  design.  Proceedings  of  the  AGAR!)  Conference  on  Guidance 
and_Cori  t  rol  Displays  (AGARD  CP  16)  ( pp .  6.1  6 .  1  0  )  . 

Cliff,  K.  C.  (1971).  The  effects  ot  attention  sharing  in  a  dynamic  dual  task 
environment.  Proceedings  of  the  7th  Annual  NASA  University  Conference  on 
Manual  control  (NASA  SP  281)  (pp.  307  325). 

Cohen,  A.  1).  (1982).  The  Hughes  Design  Analysis  System  an'  instructor 
workload  Iri  operational  trainers.  Proceedings  of  the  .'.an  Factors 
Society  26th  Annual  Meet  irig  (pp.  361  368).  Santa  Moni'i:  Human  Fa.  tors 
Soc l e t  y . 

Cohen,  A.  S.  (1977).  Is  the  duration  of  an  eye  fixation  a  sufficient  criterion 
referring  to  information  input.  Perceptual  and  Motor  Skills,  1‘>,  7m.  . 

Colie,  H.  A.  (1979).  A  <  apar  1 1  y  theoretic  approach  to  workload  assess  -ent 
(WSU  A FOUR  TK  79  1).  Dayton.  (>H:  Wright  Stale  Halve;  ,\ty.  (DTlf  So. 

AD  A0 7 8  1 32) 

Collins,  B.  K.,  Ellsworth,  P.  C.  ,  6  Helrr.rei.h.  R.  I..  (196/).  Correlations 

between  pupil  size  and  the  semantic  dl i f erent la  1 :  An  experimental  paradigm 
and  pilot  study.  Psychonotnlc  Science,  9(  1  2),  627  t28. 

Collins,  W.  E.  (  1962,  October).  Manlpulat ton  of  arousal  and  _1 1 s  effects  on 
human  vestibular  nystagmus  Induced  by  caloric  irrigation  and  angular 
acoelerat Ions  (Rep.  No.  62  17).  Oklahoma  City,  OK:  Aviation  Medical 
Service,  Aerorr.ed  teal  Research  Division,  civil  Aefxnedical  Research 
Institute,  Federal  Aviation  Agency. 


1  > 


Collins,  W.  E.,  Guedry,  F.  E..  Jr.,  &  Posner,  J.  B.  (1961,  August).  Control  of 
caloric  nystagmus  by  manipulating  arousal  and  visual  fixation  distance 
(Rep.  No.  485).  Fort  Knox,  KY:  U.S.  Army  Medical  Research  Laboratory. 

Collins,  W.  E..  &  Poe,  R.  H.  (1962).  Amphetamine,  arousal,  and  human 

vestibular  nystagmus.  Journal  of  Pharmacology  and  Experimental  Therapy. 
138,  120-125. 

Colman,  F.  D. ,  &  Palvlo,  A.  (1969).  Pupillary  response  and  galvanic  skin 
response  during  an  imagery  task.  Psychonomlc  Science,  16(6),  296-297. 

Connor,  S.  A.,  &  Wlerwllle,  W.  W.  (1983).  Comparative  evaluation  of  twenty 
p Hot  workload  assessment  measures  using  a  psychomotor  task  In  a  moving 
base  aircraft  simulator  (NASA  CR-166457).  Washington,  D.C.:  National 
Aeronautics  and  Space  Administration. 

Cooper,  G.  E.,  6  Harper,  R.  P.  (1969).  The  use  of  pilot  rating  In  the 

evaluation  of  aircraft  handling  qualities  (NASA  TN  D  5153).  Moffet  Field, 
CA:  NASA  Ames  Research  Center. 

Corkindale,  M.  G.  G.  (1974).  A  flight  simulator  study  of  missile  control 
performance  as  a  function  of  concurrent  workload.  Proceedings  of  the 
AGARU  Conference  on  Simulation  and  Study  of  High  Workload  Operations 
( AGAKD  CP  146)  (pp.  A5.1  A5.6). 

Corleit,  K.  N .  (1973).  Cardiac  arrhythmia  as  a  field  technique:  Some 
components  on  a  recent  symposium.  Ergonomics.  16,  3  4. 

rote,  Ij .  O.,  Krueger,  G.  P.,  6  Simmons.  R.  R.  (  1985).  Helicopter  copilot 
workload  during  nap  of  the  earth  fliglit.  Aviation,  space,  and 
Environmental  Medicine,  56.  153  157. 

Ci  in  1  ur  is,  G.  J.,  Ratner,  R.  S.,  Petracek,  53.  J..  Wong,  P.  J.,  f»  Ketchel,  J.  M. 
(1974).  Capacity  and  productivity  implications  on  enroute  air  traffic 
control  automat  ion  (FAA  KD  74  196).  Washington,  t) . C . ; Feder a  1  Aviation 
Adm l n i st rat  ion . 

Court  right,  J.  &  Kuperman,  G.  (  1984).  Use  of  SWAT  in  IJSAK  system  TfcK. 

Proceedings  of  the  lfjjman_ Factors  Society  28th  Annual  Meeting  (pp. 

700  703).  Santa  Monica:  Human  Factors  Society. 

Crabtree,  M.  s.  (1975).  Human  factors  evaluation  of  several  control  system 
configurations,  Including  workload  sharing  with  force  wheel  steering 
during  approach  and  fla:e  (APFDl.  TR  75  43).  Wright  Patterson  AFB.  OH: 
tJSAF  Kl  igtit  Dynamics  Laboratory. 

Crabtree,  M.  S.,  Hateman,  R.  P.,  6  Acton,  W.  it.  (  1984  ).  benefits  of  using 
objective  and  subjective  workload  measures.  Proceedings  of  the  Human 
Factors  Society  28th  Annual  Meeting  (pp.  950  953).  Sant  a  Monica:  Human 
Factors  Society. 

Cr as i  Wreck.  H.  H.,  6  McCranle,  K.  J.  (1956).  On  the  <  <  >nd  1 1  ion  i  n«j  of  1 1  n* 
pupillary  reflex.  Journal  of  Psychology ,  42.  73  27. 


HO 


Crawford,  B.  H.  (1979).  Workload  assessment  methodology  development,  in 

B.  O.  Hartman  &  R.  E.  McKenzie  (Eds.)  Survey  of  Methods  to  Assess  Workload 
(AGARD-AG-246)  (pp.  55-67).  Neuilly-sur-Seine,  France:  Advisory  Croup  for 
Aerospace  Research  and  Development. 

Crooble,  R.  B.  (1982).  Reflections  on  the  effects  of  vehicle  dynamics  and 
task  difficulty  on  Cooper-Harper  pilot  opinion  ratings,  task  performance, 
and  pilot  workload.  In  M.L.  Frazier  &  R.B.  Cromble  (Eds.),  Proceedings  of 
the  Workshop  on  Flight  Testing  to  Identify  Pilot  Workload  and  Pilot 
Dynamics  (APFTC-TR-82-5)  (pp.  102-113).  Edwards  Air  Force  Base,  CA:  Air 
Force  Flight  Test  Center.  (DTIC  No.  AD-A129  333) 

Crotnmelinck,  M. ,  6  Roucoux,  A.  (1976).  Characteristics  of  cat's  eye  saccades 
in  different  states  of  alertness.  Brain  Research,  103 ,  574-578. 

Cross,  K.  D.,  &  Cavallero,  F.  R.  (1972).  Utility  of  the  vertical  contact 
analog  display  for  carrier  landings  a  diagnostic  evaluation. 

Proceedings  of  the  AGARD  Conference  on  Guidance  and  Control  Displays 
(AGARO  CP-96)  (pp.  21.1  21.11).  (AO  739  779) 

crowne,  D.  P.  (1983).  The  frontal  eye  field  and  attention.  Psychological 
Bulletin,  93(2),  232  260. 

Curry,  R.  E.  (1979).  Mental  load  in  monitoring  tasks.  In  N.  Moray  (Ed.) 
Mental  Workload:  Its  Theory  and  Measurement  (pp.  l l /  1x4).  Hew  York: 
Plenum  Press. 

Curry,  R.  E.,  Klelnman,  U.  1...  (,  Hoffman,  W.  c.  (  1977).  A  design  procedure  fo 
control/display  systems.  Human  Factors,  19,  421  436. 

Oamos,  l).  I..  (1978).  Residual  attention  as  a  predictor  of  pilot  performance. 
Human  Factors,  20.  435  440. 

Damos,  U.  (1984).  Subjective  workload  and  individual  differences  in 

information  processing  abilities.  Proceedings  of  the  Fourth  Annual 
Aerospace  Behavioral  Engineer injg  Technology  Conference  (pp.  71  74). 

Damos,  D.  L.  (1984).  Examining  the  relationship  between  subjective  estimates 
of  workload  and  individual  differences  in  performance  ( M ASA  c/R  2341). 
Washington,  D.  C.:  National  Aeromnaut ice  and  Space  Administration. 

Damos,  D.  1,.  (1984).  Individual  differences  in  multiple  task  performance  and 
subjective  estimates  of  workload.  Perceptual  and  Motor  Skills,  59, 

567  580. 

Damos,  D.  I,.  (1984).  Class i f Icat ion  systems  foi  individual  differences  in 

multiple  task  performance  and  subjective  estimates  of  workload.  Twentieth 
Annual  Conference  on  Manual  Control  Volume  I  (Rep.  No.  NASA  CP2J41,  pp . 

97  104).  Washington,  DC:  National  Aeronautics  and  Space  Administration. 

Damos,  U.  L.  (1985).  The  relation  between  the  type  A  bchavlot  pattern,  pacing 
and  subjective  workload  under  single  and  dual  task  conditions.  Human 
Factors,  27,  675  680. 


Damos.  D.  L.  (1988).  Individual  differences  in  subjective  estimates  of 
workload.  In  P.  A.  Hancock  &  N.  Meshkati  (Eds.)  Human  mental  workload 
(pp.  231-237).  Amsterdam:  Elsevier. 

Damos,  D.  L. ,  &  Lintern,  G.  (1980).  A  comparison  of  the  predictive  validities 
of  single-  and  dual- task  measures.  Proceedings  of  the  Human  Factors 
Society  24th  Annual  Meeting  (pp.  245-248).  Santa  Monica:  Human  Factors 
Society. 

Damos,  D.,  &  Smlst,  T.  (1981).  Individual  differences  in  multi-task  response 
strategies.  Proceedings  of  the  Human  Factors  Society  25th  Annual  Meeting 
(pp.  291-295).  Santa  Monica:  Human  Factors  Society. 

Damos,  D.,  &  Vlckens,  C.  (1977).  A  quasi- linear  control  theory  analysis  of 
timesharing  skills.  Proceedings  of  the  13th  Annual  NASA-Unlverslty 
Conference  on  Manual  Control  (pp.  35-43). 

Damos,  D.,  S  Vlickens,  C.  D.  (1977).  Dual  task  performance  and  the  Hick  Hyman 
law  of  choice  reaction  time.  Journal  of  Motor  Behavior,  9,  209-215. 

Daniel,  R.  S.  (1967).  Alpha  and  Theta  KEG  in  vlgi Lance.  Perceptual  and  Motor 
Skills,  25,  697  703. 

Daniels,  A.  K.  (1970).  Crew  workload  sharing  assessment  In  all  weather,  low 
level  strike  aircraft .  In  Problems  of  the Cockpit  Environment  ( AC AK) 
Conference  Proceedings  NO.  55)  (pp.  12.1  12.9).  (AD  705  369). 

Davies,  P.  J.  (  1982,  September).  Attention,  arousal,  cognitive  performance 
lateral  eye  movements.  Dissertation  Abstracts  International,  43(3). 

Deaton,  j.  fj .  ,  (,  parasuraman,  R.  (1988).  Effects  of  task  demands  and  age- 

vigilance  and  subjective  workload .  Proceedings  of  t ho JIuman  Factors 
Socket y  32nd  Annual  MeetinO  (pp.  1458  1462).  Santa  Monica,  CA:  Human 
Factors  S<>? let y. 

Detayolle,  M.,  Dinand,  J.  P.,  6  Cent U ,  M.  T.  (1973).  Averaged  evoked 

potentials  in  relation  to  attitude,  mental  load,  and  intelligence.  In  W. 
T.  Singleton,  J.  G.  Fox,  6  D.  Whitfield  (Kds.),  Measurement  of  Man  at  Work 
(pp.  81  91).  lx>ndon:  Taylor  and  Francis. 

DeMalo,  J.,  Hell,  M.  II.,  6  Hr  undorman ,  J.  (  1983).  Pilot  oriented  per  for  man*  <- 
measurement .  Proceedings  ot  the  Human  Factors  Society  27th  Annual  Meeting 
(pp.  463  467).  Santa  Monica:  Human  Factors  Society. 

Derrick,  W.  L.  (1981).  The  relationship  between  processing  resources  and 
subjective  dimensions  of  operator  workload.  Prof ^qdlngs  of  the  Human 
Factors  Society  25th  Annual  Meeting  (pp.  532  536).  Santa  Monica:  Human 
Fcators  Society. 

Derrick,  V.  L.  (1983).  Examination  of  workload  measures  with  subject ive 
task  clusters.  Proceedings  of  the  Human  Factors  Society  27th  Annual 
Meeting  (pp.  134  1  38).  Sant  a  Monica:  Human  Factors  Society. 


V)  1 


Derrick,  W.  L.  (1988).  Dimensions  of  operator  workload.  Human  Factors.  30, 
95-100. 

Derrick,  V.  L.,  &  McCloy,  T.  M.  (1984).  An  empirical  demonstration  of 

multiple  resources.  Proceedings  of  the  Human  Factors  Society  28th  Annual 
Meeting  (pp.  26-30).  Santa  Monica:  Human  Pactors  Society. 

Detro,  s.  (1985).  Subjective  assessment  of  pilot  workload  In  the  advanced 
fighter  cockpit.  Proceedings  of  the  Third  Symposium  on  Aviation 
Psychology .  Columbus,  OH:  The  Ohio  State  University. 

Dick,  A.  O.  (1980).  Instrument  scanning  and  controlling:  Using  eye  movement 
data  to  understand  pilot  behavior  and  strategies  (CR-3306).  Washington, 
D.C.:  NASA. 

Dick,  A.  O. ,  6  Bailey,  G.  (1976).  A  comparison  between  oculomoter  data  and 
pl lot  op In Ion  on  the  usefulness  of  Instruments  during  la ndi n  g  (Technical 
Report  No.  3-76).  Rochester,  New  York:  University  of  Rochester,  Center 
for  visual  Science. 

Dick,  A.  O.,  Brown,  J.  L.  6  Bailey,  G.  (1976).  Statistical  evaluation  of 

control  inputs  and  eye  movements  In  the  use  of  Instrument  clusters  during 
a Ijrcraft  landing  (Technical  Report  4  76).  Rochester,  New  York:  University 
of  Rochester.  Centot  for  Visual  Science. 

Donchin,  K.  (  1979).  Event  related  brain  potentials:  A  tool  In  the  study  <>f 

hiiman  Information  processing.  In  H.  Begleiter  ( Kd . )  Kvokcd  potentials  and 
behavior .  New  York:  Plunum. 

Donchin,  E.,  Coles,  M. ,  6  Kramer,  A.  (1988,  Kebiuaty).  The  event  related  brain 
potential  as  an  Index  of  information  processing  and  cognitive  activity:  A 
program  of  basic  research  (Tech.  Rep.  No.  PI.  88  l).  Bolling  Mr  Fori- 
Base,  DC:  l.ife  Sciences  Directorate,  Air  Force  Office  of  Scientific 
Resear  oh . 


Donchin,  K.,  Coles,  M.,  6  Kramer,  A.  (1987,  February).  The  event  related  hrain 
potential  as:  an  index  of  information  processing  ana  cognitive  activity 
(Tech.  Rep.  No.  CPI,  87  l).  Bolling  Air  Korce  Base,  lx':  l.ife  Sciences 
Directorate,  Air  Force  Office  of  Scientific  Kesearin. 

Donchin,  K . ,  Kramer,  A.  F. ,  6  Wickeris,  C.  (  1986).  App 1  leaf  tons  of  hrain  event 
related  pot  etit  »a  1  s  to  problems  In  engineering  psychology.  In  M.  r; .  H. 
Coles,  K.  Donchin,  6  S.  W.  Forges  (Kds.),  Psychophysiology:  Systems, 
Processes,  and  Applications  (pp.  702  718).  Ne--  York:  Guilford. 

Donchin,  K.,  Ritter,  W. ,  6  McCallum.  C.  (1978).  Cognitive  psychophysiology: 
The  engogenous  components  of  the  KKP.  In  E.  Callaway,  P.  Tuet Ing,  6  S.  H. 
Koslow  (Eds.),  Event  related  brain  potentials  in  man  (pp.  3-19  396).  New 
York:  Academic  Press. 

Donchin,  K..  6  Wickens,  C.  0.  (1980,  November).  Appl Icat Ions  of  event  related 
brain  potentials  In  human  engineering.  Annual_  Progress  Report t  Appendices 
(AFOGK  1 K  11  0106).  Moiling  Air  Force  Base,  DC:  Air  For  office  of 
Scientific  Research.  ( NT  I G  No.  AD  A097542) 


Donchin,  E. ,  Wlckens,  C..  6  Coles,  M.  G.  H.  (1983.  November),  The  event 

related  brain  potential  as  an  Index  of  Information  processing,  cognitive 
activity,  and  skill  acquisition:  A  program  of  basic  research  (Rep.  No. 
CPL83-4/P49620-79-0233) .  Bolling  Air  Force  Base,  DC:  Air  Force  Office  of 
Scientific  Research. 

Donnell,  M.  L.  (1979).  The  application  of  decision-analytic  techniques  to  the 
test  and  evaluation  phase  of  the  acquisition  of  a  major  air  system:  Phase 
III  (TR  PR-79-6-91).  McLean,  VA:  Decisions  and  Designs. 

Donnell.  M.  L.,  &  O’Connor,  M.  F.  (1978).  The  application  of  decision 

analytic  techniques  to  the  test  and  evaluation  phase  of  the  acquisition  of 
a  major  air  system:  Phase  II  (Technical  Report  TR  78-3  25).  McLean,  VA: 
Decisions  and  Designs. 

Drennen,  T.  G . ,  Curtin,  J.  G.,  6  Warner.  H.  D.  (1977).  Manual  control  In 
target  tracking  tasks  as  a  function  of  control  _typeL  task  loading,  and 
vlbrat Ion  (MDCE  1713).  St.  Louis,  MO:  McDonnell  Douglas  Corporation. 

Duncan  Johnson,  C.  C.,  6  Donchin,  K.  (1977).  on  quantifying  surprise:  The 
variation  In  event  related  potentials  with  subjective  probability. 
Psychophysiology,  M,  456  467. 

Duncan  Johnson,  C.  C. ,  6  Donchin,  K.  (1982).  The  P  100  component  of  the 
event  related  brain  potential  as  an  index  of  Information  processing. 
Biological  Psychology,  14,  l  52. 

Dunn,  R.  S.  (1982).  Army  workload  research  and  development  requirements.  In 
M.L.  Frazier  &  R.B.  Cromble  (Kds.),  Proceedings  of  the  Workshop  on  F Ugh t 
Testing  to  Identify  Pilot  Workload  and  Pilot  Dynamics  ( AFFTC  TK  82  5)  (pp. 
20  25).  Edwards  Air  Force  Base,  CA:  Air  Force  Flight  Test  Center.  (DT1C 
No.  AD  A129  113) 

Dorm ,  F.  b .  ,  ,  Gil  son ,  R .  D . ,  6  bun ,  P .  (19/6).  A  simulator  s  t udy  of  he  1 i cop  t  e  r 
pilot  workload  reduction  using  a  tactile  display.  Proceedings  of  the  !/th 
Annual  NASA ^University  Conference  on  Manual  Control..  (NASA  TMX  71  170)  ( pp . 
155  160) . 

Eckel,  J.  S. ,  6  Crabtree,  M.  b.  (1983).  Analytic  and  subjective  assessment  ,  ■  >f 
operator  workload  Imposed  by  communirat  ion  tasks  In  transport  aircraft. 
Proceedings  of  the  Second  bympos 1  urn  on  Aviation  Psychology  (pp.  217  24  1  ). 

Edwards,  t..  R.,  Pilette,  b.  !!.,  Higgs,  H.  E.,  6  Martii.ek,  It.  (  1978).  lire 
'*L£?.ct.  workload  on  performance  of  operators  monitor  log  unat  tended 
ground  sensors  (Technical  Paper  321).  Alexandria.  VA:  US  Army  Research 
Institute  for  the  Behavioral  and  Social  Sciences.  (AD  A061  694) 

Kgeth,  H.  E.  (1975).  Perception  and  at  tent 'on  (Department  of  Psychology 

Rei»ort  No.  81).  Baltimore,  Ml):  The  Johns  Hopkins  University.  (AD  A014 


Eggemeler,  P.  T.  (1980).  Some  current  Issues  in  workload  assessment. 
Proceedings  of  the  Human  Factors  Society  24th  Annual  Meeting  (pp. 

669-673).  Santa  Monica:  Human  Factors  Society. 

Eggemeler,  F.  T.  (1981).  Current  Issues  in  subjective  assessment  of  workload. 
Proceedings  of  the  Human  Factors  Society  25th  Annual  Meeting  (pp. 

513-517).  Santa  Monica:  Human  Factors  Society. 

Eggemeler,  P.  T.,  Crabtree,  M.  S.,  &  LaPointe,  P.  A.  (1983).  The  effect  of 
delayed  report  on  subjective  ratings  of  mental  workload.  Proceedings  of 
the  Human  Factors  Society  27th  Annual  Meeting  (pp.  139-143).  Santa 
Monica:  Human  Factors  Society. 

Eggemeler,  P.  T. ,  Crabtree,  M.  s.,  7,lnqq,  J.  J..  Reid,  G.  B.,  6 

Shingledecker ,  C.  A.  (1982).  Subjective  workload  assessment  in  a  memory 
update  task.  Proceedings  of  the  Human  Factors  Society  26th  Annual  Meeting 
(pp.  643  647).  Santa  Monica:  Human  Factors  Society. 

Eqqemeler,  F.  T. ,  Melville,  B.  E.,  &  Crabtree,  M.  S.  (1984).  The  effect 
of  intervenlnq  task  performance  on  subjective  workload  ratlnqs. 

Proceedings  of  the  Human  Factors  Society  28th  Annual  Meeting  (pp. 

954  958).  Santa  Monica:  Human  Factors  Society. 

Eqqemeler,  F.  T. ,  Shingledecker,  O.  A.,  &  Crabtree,  M.  S.  (1985).  Workload 
measurement  in  system  design  and  evaluation.  Proceedings  of  the  Human 
Factors  Society  29th  Annual  Meeting  (pp.  215  219).  Santa  Monica:  Human 
Factors  Society. 

Eggemeler,  F.  T. ,  6  Stadler,  M.  A.  (1984).  Subjective  workload  assessment 
in  a  spatial  memory  task.  Proceedings  of  the  Human  Fa<  tors  society  28rh 
Annua  1  JMeet Ing  (pp.  680  684).  Santa  Monica:  Hu~an  Factors  Society. 

Eggleston,  K.  G.,  8  Kulwickl,  P.  V.  (1984).  A  t e< hnology  forecasting  and 
assessment  method  for  evaluating  system  utility  and  operator  work  load . 
Proceedings  of  _the_.  Human.  Factors  Society  28th  Annual  Meeting  (pp.  3  1  35). 
Santa  Monica:  Human  Factors  Society. 

Eggleston,  R.  G.,  6  yuinn.  T.  J.  (1984).  A  pt e l im  i  nat y  evaluation  of  a 

projective  workload  assessment  method.  Proceeding:*  of  the  Human  Factors 
Society  28th  Annual  Meeting  (pp.  695  699).  Santa  Monica:  Hunan  Factors 
Soo i e t  y . 

Ellis,  G.  A.  (1978).  Subjective  assessment.  In  A.  H.  Roscoe  (Ed.)  Assessing 
pljot  work  load .  (AGAKU  AG  231)  (pp.  j[  2?)  .  (AD  AOS  1  587) 

Ellison,  M.  (}.,  ft  Roberts,  B.  B.  (  1985).  Tlmebased  analysis  of  significant 
coord inated  operations  (TASCO):  A  cockpit  workload  analysis  technique. 
Proceedings  jaf  the  Human  Factors  Society  29th  Annual  Meet ing  ( pp . 

774  778).  Santa  Monica:  Human  Factors  Society. 

Elshtain,  E.  I,.,  6  Schaefer,  T.,  Jr.  (1968).  Effects  of  storage  load  and  word 
frequency  on  pupillary  responses  during  short  term  memory.  Psychonpmic 
Science,  12(4),  143  144. 


Enstrom,  K.  D.,  &  Rouse,  V.  B.  (1976).  Telling  a  computer  how  a  human  has 

allocated  his  attention  between  control  and  monitoring  tasks.  Proceedings 
of  the  12th  Annual  NASA-Unlverslty  Conference  on  Manual  Control  (NASA  TM 
X-73,  70)  (pp.  104-123). 

Enstrom.  K.  D.,  &  Rouse,  W.  B.  (1977).  Real-time  determination  of  how  a 
human  has  allocated  his  attention  between  control  and  monitoring  tasks. 
IEEE  Transactions  on  Systems,  Man,  and  Cybernetics  (SMC-7)  (pp.  153-161). 

Ephrath,  A.  R.  (1976).  A  novel  approach  to  the  cross- adapt ive  auxiliary  task. 
Proceedings  of  the  12th  Annual  NASA-Unlverslty  Conference  on  Manual 
Control  (NASA  TMX-73.  170)  (pp.  63-71). 

Eprath,  A.  R.,  6  Curry,  K.  E.  (1977).  Detection  by  pilots  of  system  failures 
during  Instrument  landings.  IEEE  Transactions  on  Systems,  Man^  and 
Cybernetics  (SMC  7)  (pp.  841  848). 

Ephrath,  A.  K.,  Tole,  J.  R..  Stephens,  A.  T. ,  6  Young,  I..  K.  (1980). 

Instrument  scan  Is  it  an  indicator  of  the  pilot’s  workload?  Proceedings 
of  the  Human  Factors  Soc'ety  24th  Annual  Meeting  (pp.  267  268).  Santa 
Monica:  Human  Factors  Society. 

Kttema,  J.  H.,  6  7,ielhuis,  K.  L.  (1971).  physiological  parameters  of  mental 
load.  Krgonrxnlcs ,  14,  137  144. 

Fabianl,  M.,  Grafton,  G..  Karis,  I).,  6  Donchin,  K.  (1987).  Definition, 

ident 1 f icar ion,  and  reliability  of  measurement  of  the  P300  component  of 
the  event  related  brain  potential.  Advances  In  Psychophysiology,  2,  1  78. 

Earher,  K.,  6  Gallagher,  V-  (1972).  At t ent iona l  demands  as  a  measure  of  the 
influence  of  visibility  condlM  -ns  on  driving  task  difficulty.  Highway 
Research  Record,  414,  1  6. 

Fisk,  A.  1) .  ,  Derrick,  W.  t..,  6  Sctine  id«T  ,  W.  (1983).  The  .rivc.'ctit  of 

workload:  Dual  task  methodology .  Proceedings  of  the  Hum  m  Ea<  tors  Society 
27th  Annual  Meeting  ( pp .  ?29  23  3).  Santa  Mono  i:  Human  !t  tors  Society. 

Font  en>*  \  1 1* ,  6  t.augheiy,  K.  K.  (1988).  A  worklo.nl  ,r.s  -<*nt  aid  for 

human  engineering  design.  Proceedings  of  the  Human  Factors  Society  12nd 
Annual  Meeting  ( pp .  1122  1124).  Santa  Monica,  <  A :  Hu- at.  Fa-  tot  s  Society. 

Fra/,  let,  M.  I..,  Cromhie,  K.  H.  (Eds.).  (  1982).  Proceedings  «>(  ttie  Workshop  on 
Flight  Testing  to  Identity  Pilot  Workload  and  Pilot  Dynamics  (AFFTC  TR 
82  8)  Edwards  Air  Force  Base,  CA :  Air  Force  Flight  Test  (’enter  .  (DT1C  So. 
AD  Al 29  333) 

Furedy,  J.  J.  (  1987).  Beyond  heart  rate  In  the  cardiac  psychophys iolog lea  1 
assessment  of  mental  effort:  The  T  wave  amplitude  component  of  the 
electrocardiogram.  Human  Factors,  29,  183  194. 

Gaarder,  K.  (  1967).  Sortie  patterns  of  fixation  saccadic  eye  movements. 
Psychonomlc  Science,  7(4),  148  146. 


Gevlns,  A.  S.  (1987,  September).  Neurocognltive  predictors  of  performance 

(APOSR03) .  Bolling  Air  Force  Base,  DC:  Directorate  of  Life  Sciences,  Air 
Force  Office  of  Scientific  Research. 

Gevlns,  A.  S.,  Bressler,  S.  L.,  Cutllio,  B.  A.,  Doyle,  J.  C.,  Nelson,  H.,  & 
Zeitlln,  G.  M.  (1984,  October).  Neurocognltive  pattern  analysis  of  an 
auditory  and  visual  numeric  motor  control  task.  Part  1:  Development  of 
methods  (AFOSR- TR-84-1107) .  Bolling  Air  Force  Base,  DC:  Directorate  of 
Life  Sciences,  Air  Force  Office  of  Scientific  Research.  (NT1S  No.  AD 
A148809) 

Gevlns,  A.  S.,  Morgan,  N.  H..  Bressler,  S.  L.,  Cutllio,  B.  A.,  White,  R.  M. , 
Hies,  J.,  Greer,  D.  S.,  &  Doyle,  J.  C.  (1986,  July).  Neuroelectric 
predictors  of  performance  accuracy  (AFOSR-04).  Bolling  Air  Force  Base, 
DC:  Directorate  of  Life  Sciences,  Air  Force  Office  of  Scientific  Research 

Gevins,  A.  S.,  Morgan,  N.  H.,  Bressler,  S.  L.,  Cutillo.  B.  A.,  White,  K.  M., 

I  lies,  J.,  Greer,  D .  S.,  Doyle,  J.  C.,  &  Zeitlln,  G.  M.  (  1986).  Human 
neuroelectric  patterns  predict  performance  accuracy.  Science,  235, 

580  585. 


Gill,  N.  T.,  6  Wickens,  C.  t).  (  1983).  Operator  workload  as  a  function  of 
the  system  state:  An  analysis  based  upon  the  event  related  brain 
potential.  Proceedings  of  the  18th  Annual  Conference  on  Manual  Control 
(AFWAI.  TK  83  1021)  ( pp .  100  107  ).  (OTIC  No.  AD  A 1 3 1  756  ). 

Glen,  K.  A.  III.,  Dirk,  A.  0.,  f,  Bittner,  A.  C.  Jr.  (19B7).  Pred  Set  ioti  of 
personnel  requirements  for  system  operation.  Proceedings  of  the  Human 
Factors  Society  31st  Annual  Meeting  (pp.  358  367),  Santa  Monica.  CA :  The 
Human  Factors  ;<x  i»-ty. 

Glenn,  K.  A.,  /.aklad.  A.  I..,  6  Wherry,  H.  J.,  Jr.  (1982).  Human  operator 
simulation  in  t he  cognitive  domain.  Proceedings  °*  1  he  Human  Factors 

Society  26th  Annual  Meeting  (pp.  964  968).  Santa  Monica:  Human  Factors 
Sor  t  <•  t  y  . 

Goettl,  B.  P.  (  1985).  The  interfering  effects  of  pro,  cosing  •  <*de  or,  visual 

memory.  Proceedings  of  the  Human  Factors  Society  29  th  Annual  Meeting  < pp 
66  70).  Santa  Monica:  Human  Factors  Society. 

Goldwater  ,  B.  C.  (197/).  Psycholog  lea  1  s  i  gn  1  f  trance  <•(  pupillary  ive-ent  •,  . 
Psychological  Bulletin,  77(5),  340  355. 

Gopher,  D.  (1980).  On  the  training  of  time  sharing  skills:  An  attention 

viewpoint.  Proceedings  of  the  Human  Factors  Society  24th  Annual  Meeting 
(pp.  259  263).  Santa  Monica:  Human  Factors  Society. 

Gopher,  D.  (  1984).  Work  load  book :  Assessment  of_  operator  workload  in 
engineering  systems  (NASA  c;k  166596).  Washington,  D.C. :  National 
Aeronaut ics  and  Space  Administration. 


H7 


Gopher.  D.  (1984).  Measurement  of  workload:  Physics,  psychophysics,  and 

metaphysics.  Twentieth  Annual  Conference  on  Manual  Control  (Rep.  No.  NASA 
CP  2341,  p.  55).  Moffett  Field,  CA:  National  Aeronautics  and  Space 
Administration. 

Gopher,  D. ,  &  Braune,  R.  (1984).  On  the  psychophysics  of  workload:  Why  bother 
with  subjective  measures?  Human  Factors.  26(5),  519-532. 

Gopher,  0.  Chillag,  N.,  &  Arzi,  N.  (1985).  The  Influence  of  voluntary 

effort,  context,  and  anchor  task  on  the  subjective  estimate  of  load  (Final 
Report  for  NASA  Grant  NAGW-494).  Haifa,  Israel:  Technlon. 

Gopher,  D.  Chillag,  N.,  &  Arzi,  N.  (1985).  The  psychophysics  of  workload 
A  second  look  at  the  relationship  between  subjective  measures  and 
performance.  Proceedings  of  the  Human  Factors  Society  29 th  Annual  Meeting 
(pp.  640  664).  Santa  Monica:  Human  Factors  Society. 

Gopher,  0.  &  Uonchirt,  K.  (1986).  Workload  An  examination  of  the  concept . 

In  K.  R.  Boff,  L.  Kaufman.  &  J.  P.  Thomas  (Eds.),  Handbook  of  perception 
and  hitman  performance:  Vol.  1 1.  Cognitive  processes  and  performance  (pp. 

41  1  41  49).  flew  York:  John  Wiley  &  Sons. 

Gopher,  L> . ,  6  North,  N.  A.  (  1974).  The  measurement  of  attention  capacity 

through  concurrent  task  performance  with  individual  difficulty  levels  and 
shifting  priorities.  Proceedings  of  the  Human  Factors  Society  18th  Ate, sal 
Meeting  (pp.  480  488).  Santa  Monica:  Human  Factors  Society. 

Gould,  J.  1)..  6  Schaffer.  A.  (1968).  Eye  movement  pattern',  during  visual 
infrjrv.it  ion  processing.  Psyehotiomic:  Science,  3.  717  718. 

Gtaaff,  k.  van  d>*  t  1982) .  NI.K  Research  on  pilot  dyna-ies  md  wot  k  1  id  in 

M.  I..  I- •  i/ier  >,  k.  ii.  crumble  (Kds.),  Proceedings  <>(  the  Wotkstiop  ,n 
Flight  Testing  to  Identify  Pilot  Workload  and  Pilot  Dynamics 
(AFFTC  Tk  87  8)  (pp.  /  9  90).  Edwards  Mr  Force  Has.* .  fA :  Mr  F  a  -  •• 

Test  Center,  f '  )T  1  <  7  No.  At)  Al?9  m) 

Grift  in,  k.  (1986,  April).  Toward  an  integrated  theory  of  t  a-  k  design  i'!'k  sw 
lx;  1/).  Arlington.  VA  :  Or  gan  i  /.at  Iona  l  Kt  f  t  i  verie-.s  Fe  .ear  I;  In  ■  ig  :  a  ,  , 
Office  of  Naval  Research.  ( NT  I S  No.  At)  A168987) 

( iu 1 l ok ,  k .  (1987).  Va 1 i da  t  ion  on  pilot  wor  k I  <  >ad  estimates  utilizing  in  Might 
data.  In  M.  t..  Frazier  6  k.  M.  Crumble  (Kds.).  Pr  ■ * ■»•,•<)  1  ng-.  of  the 
Workshop  on  Flight  Testing  to  Identify  Pilot  Workload  and  Pilot  Dynamo  s 
(AFFTC  Tk  82  8)  ( pp .  284  274).  Edwards  Air  Force  Has*-,  ('A:  Ait  Force 
Flight  Test  Center.  (OTIC  No.  AD  A 1 29  737) 

Gunning,  D.,  6  Manning.  M.  (1980).  The  measurement  of  aircrew  task  loading 
during  operational  fights.  Proceedings  of  the  Human  Factors  Society  74th 
Annual  Meeting  (pp.  249  282).  Santa  Monica:  Human  Factors  Society. 

Hall,  R.  J.,  Rosenbetger,  M.  A..  6  Monty,  R.  A.  (1973,  October).  An 

experimental  Investigation  of  the  visual  behavior  of  young  heroin  addicts 
and  matched  controls  (Technical  Memorandum  28  73).  Aberdeen  Proving 
Ground,  Ml):  tJ.S.  Army  Human  Engineering  f.ulior  a  t  or  y  . 


Hancock,  P.  A.  (1986).  The  role  of  temporal  factors  In  workload  prediction. 
Proceedings  of  the  1986  IEEE  Internat tonal  Conference  on  Systems,  Man,  & 


Cybernet lcs  (pp.  1049-1053). 

Hancock,  P.  A.  (1986).  The  effect  of  skills  on  performance  under  an 

environmental  stressor.  Aviation.  Space,  and  Environmental  Medicine,  57, 
59-64. 

Hancock,  P.  A.,  6  Meshkatl,  N.  (Eds.)  (1988).  Human  mental  workload. 

Amsterdam:  Elsevier. 

Hancock,  P.  A.,  Rodenburg,  W.  0.,  Mathews,  V.  D.,  6  Vercruyssen,  M.  (1988). 
Estimation  of  duration  and  mental  workload  at  differing  times  of  the  day 
by  males  and  females.  Proceedings  of  the  Human  factors  Society  32nd 
Annual  Meeting  (pp.  857-861).  Santa  Monica,  CA:  Human  Factors  Society. 

Hancock ,  P.  A.,  Meshkatl,  N.,  &  Robertson,  M.  M.  (1985).  Physiological 
reflections  of  mental  workload.  Aviation,  Space,  and  Environmental 
Medicine,  56,  1110  1114. 

Harris,  K .  I,.,  Sr.,  Tole,  J.  R.,  Kphrath,  A.  W..  5  Stephens,  A.  T.  (1982). 

How  a  now  instrument  affects  pilots'  mental  workload.  Proceedings  of  the 
Human  Factors  Society  26th_Annual  Meeting  (pp.  1010  19]')).  Santa  Monica: 
Human  Factors  Society. 

liar  tis,  R.  M.  .  lavocchla.  It.  p.  .  Ross,  I..  V.,  f.  shat  I  ,  S.  c.  (138/). 

Microcomputer  human  operator  simulator  (H<»S  IV,.  I  •  r  •  >  lings  o(  the  list 

Annual  Meeting  of  the  Human  Factors  Society  t  pp.  1  !  /'•  119't).  Santa 
Monica,  CA:  Human  Factors  Society. 

Hart,  S.  G.  (1986).  The  relationship  between  workload  a  •:  ituic):  Ati 
i  nt  roduct  ion .  Proceedings  of  the  Human  Fact  ot  •>  So*  i"t  y  i0»h  Annual 
Meeting  ( pp .  1116  1120).  Santa  Monica:  Human  F  e  t  -<t  ■■  iety. 

Hart,  S.  G.  (1986  ).  Theory  and  ir.easut  e, of  to  j  - . ,  1 1 ,  w- -r  •  .  >ad  .  In 

J.  /.elilnet  (Ed.),  Human  productivity  enhancement:  Vo ;  .  I.  Training  and 
tinman  factors  in  system  design  (pp.  396  455).  Sew  York:  Praejer  . 

Kart.  S.  G..  Itatti.te.  v.,  8  Hester  ,  P.  T.  i  I  981 .  pop-  no;:  A  sup**:  .-  i ,r  y 

control  simulation  tot  workload  and  pert'  I  -at,  •  •  teaua-fi.  Pto.  eedlngs  of 
t  he  20  th  Annual  conference  on  Manual  Control  ( pp .  4  1 1  4‘  t).  SA  :a  294  1. 

Hart,  S .  G .  ,  6  lt<>r  t  o  1  uss  i  ,  M .  R  .  (1984).  Pilot  errors  is  a  son  r  e  of 
'workload.  Human  Factors.  26,  545  556. 

Hart,  S.  <*.,  6  Gtiappell,  S.  1,.  (1981).  Influence  of  pilot  'workload  and  tt  title 

information  on  pilot’s  situation  awareness.  Pt oceen 1 ngs  of  the  19th 
Annual  Conference  on  Manual  Control  (pp.  1  26). 

Hart,  S.  (1 .  ,  Childress,  M.  K.,  6  Hortolussl,  M.  (1981).  tiefining  t  fie  sub 

jectlve  experience  of  wor  k  1  c  >ad  .  Proceedings  of  t  tie  Human  Ka<  tot1-  Sen  l  <>  t  y 
25lh  Annual  Meeting  ( pp .  52/  ‘ill).  Santa  Monica :  Human  Fat  tots  •  o,  iety. 


me  at* 


Hart,  S.  G.,  Childress,  M.  E. ,  &  Hauser,  J.  R.  (1982).  Individual  definitions 
of  the  term  "workload."  Proceedings  of  the  Eighth  Psychology  in  the  DoO 
Symposium  (pp.  478-485). 

Hart,  S.  G.,  &  Hauser,  J.  R.  (1987).  Inflight  application  of  three  pilot 
workload  measurement  techniques.  Aviation,  Space,  and  Environmental 
Medicine.  58.  402-410. 

Hart,  S.  G.,  Hauser,  J.  R..  &  Lester,  P.  T.  (1984).  Inflight  evaluation 
of  four  measures  of  pilot  workload.  Proceedings  of  the  Human  Factors 
Society  28th  Annual  Meeting  (pp.  945-949).  Santa  Monica:  Human  Factors 
Society. 

Hart,  S.  G.,  Sellers,  J.  J.,  &  Guthart.  G.  (1984).  The  impact  of  response 
selection  and  response  execution  difficulty  on  the  subjective  experience 
of  workload.  Proceedings  of  the  Human  Factors  Society  28th  Annual  Meeting 
(pp.  732-736).  Santa  Monica:  Human  Factors  Society. 

Hart,  S.  G.,  6  Sheridan,  T.  B.  (1984).  Pilot  workload  performance  and 

aircraft  control  automation.  Aqard  Conference  Proceedings  Ho.  371:  Human 
factors  considerations  in  high  performance  aircraft  (pp.  18.1- 18.12). 
Neullly-sur  Seine.  France:  Advisory  Group  for  Research  &  Development. 

Hart.  S.  G..  Shively,  R.  J.,  Vidullch,  M.  A.,  f.  Miller,  R .  C.  (1986).  The 
effects  of  stimulus  modality  and  task  integrality:  Predicting  dual  task 
performance  and  -workload  from  single  task  levels.  Proceedings  of  the  21st 
Annual  Conference  on  Manual  Control  (pp.  5.1-5.18).  NASA  CP  2428. 

Hart.  S.  G..  &  Stave  land,  I..  K.  (  1988).  Development  of  a  NASA  TI.X  (Task  Ixjad 
Index):  Results  of  empirical  and  theoretical  research.  In  P.  S.  Hancock  6 
N.  Meshkat l  (Eds.),  Human  mental  workload.  Amsterdam:  Elsevier. 

Hartman,  B.  O.  (Ed.).  (1978).  Methods  to  assess  workload  (AGARD  CP  216). 

Neul l ly  sur  Seine,  France:  Advisory  Group  for  Aerospace  Research  and 
Development.  (DT1C  No.  AD-  A05 7  835). 

Hartman,  B.  O. ,  6  McKenzie,  R.  E.  (Eds.).  (1979).  Survey  of  methods  to 

assess  workload  (AGARD  AG  246).  Neuilly  sur  Seine,  France:  Advisory  Group 
for  Aerospace  Research  and  Development.  (DTIC  No.  AD  A078  319). 

Haskell,  B.  E. ,  6  Reid,  G.  B.  (1987).  The  subjective  perception  of  workload 
in  low  time  private  pilots:  A  preliminary  study.  Aviation,  Space,  and 
Environmental  Medicine,  58.  1230  1232. 

Hauser,  J.  R.,  Childress,  M.  E.,  6  Hart,  S.  G.  (1983).  Rating  consistency  and 
component  salience  In  subjective  workload  estimation.  Proceedings  of  the 
18th  Annual  Conference  on  Manual  Control  (pp.  127  149) 

(AFWAL  TR  83  3021).  (DTIC  No.  AD  A131  256) . 

Hauser,  J.  R.,  6  Hart.  S.  G.  (1983).  The  effect  of  feedback  on  subjective 
and  objective  measures  of  workload  and  performance.  Proceedings  of  the 
Human  Factors  Society  27th  Annual  Meeting  (p.  144).  Santa  Monica:  Human 
Factors  Society. 


90 


Hauser,  J.  R. ,  &  Hart,  S.  C.  (1983).  Subjective  workload  experienced  during 
pursuit  tracking  as  a  function  of  avallble  Information.  Proceedings  of 
the  19th  Annual  conference  on  Manual  Control  (p.  3).  Cambridge,  KA: 
Massachusetts  institute  of  Technology. 

Hawkins,  H.  L. ,  &  Ketchum,  R.  0.  (1980).  The  case  against  secondary  task 

analysis  of  mental  workload  (TR-6).  Eugene :  Oregon  University.  (DT1C  No. 
AD-A080) 

Haworth,  L.  A. ,  Bivens,  C.  C.,  &  Shively,  R.  J.  (1986).  An  Investigation 

of  single-piloted  cockpit  and  control  configurations  for  nap-of-the-earth 
helicopter  combat  mission  tasks.  Proceedings  of  the  1986  Meeting  of  the 
American  Helicopter  Society  (pp.  657-672). 

Heffley,  R.  K.  (1983).  Pilot  workload  In  total  pi  lot- vehicle  task  system. 
Proceedings  of  the  Human  Factors  Society  27th  Annual  Meeting  (pp. 

234-238).  Santa  Monica:  Hunan  Pactors  Society. 

Heffley,  R.  K..  Clement,  W.  P.,  &  Jewell,  W.  F.  (1982).  Overview  of  work 
in  progress  on  non  intrusive  assessment  of  pilot  workload  and  pilot 
dynamics.  In  M.  L.  Frailer  &  R.  B.  Crombie  (Eds.),  Proceedings  of  the 
Workshop  on  Flight  Testing  to  Identify  Pilot  Workload  and  p 1  lot  Dynamics 
(AFFTC  TK  82  5)  (pp.  516-550).  Edwards  Air  Force  Base,  CA:  Air  Force 
Flight  Test  Center.  (DT1C  No.  ADA129  333) 

Helm,  w.  K .  (1975).  The  function  description  inventory  as  a  human  factors 
tool  In  evaluating  system  effectiveness  In  operational  environments. 
Proceedings  of  the  Human  Factors  Society  19th  Annual  Meeting  (pp. 

206  208).  Santa  Monica:  Human  Factors  society. 

Hortzog,  C.,  Kaskind,  C.  L. ,  6  Cannon,  C.  J.  (1986).  Age  related  slowing  In 
riemant Ic  information  processing  speed:  An  individual  difference  ana  lysis. 
Journal  of  Gerontology ,  41(4),  500  502. 

Hess,  K.  H.,  fc  Polt,  J.  M.  (I960).  Pupil  size  as  related  to  Interest  value  of 
visual  stimuli.  Science,  132,  349  350. 

Hess,  K.  H.,  6  Polt,  J .  M.  (1963).  Pupil  size  In  relation  to  mental  acuity 
during  simple  problem  solving.  Science,  140,  1190  1L92. 

Hicks,  T.  (}.,  K  Wlerwille,  W.  W.  (1979).  Comparison  of  Five  mental  workload 
assessment  procedures  In  a  moving  base  driving  simulator.  Human  Factors. 
21(2).  129  143. 

Hill,  S.  G.,  Plamondon,  B. ,  Wlerwille,  w.  W. ,  Lysaght,  K .  J.,  Dick,  A.  O. .  & 
Bittner.  A.  C.  (1987).  Analytic  techniques  for  the  assessment  of  operator 
work  load .  Proceedings  of  the  Human  Pactors  Society  32nd  Annual  Meet Ing . 
Santa  Monica,  CA:  Human  Factors  Society. 

Hill,  S.  G.,  Zaklad,  A.  L. ,  Bittner,  A.  C.,  Jr..  Byers.  J.  C.,  6  Christ,  R.  E . 
Workload  assessment  of  a  mobile  air  defense  missile  system.  Proceedings 
of  th«»  Human  Factors  Society  3?r,d  Annual  Meeting  .  '.!(•  1072).  San1  a 
Monica,  CA:  Human  Factors  Society. 


91 


Hill,  S.  G.,  PI amend on,  B.  D. ,  Wierwllle,  W.  W.,  Lysaght,  R.  J.,  Dick.  A.  0., 

6  Bittner,  A.  C.  (1987).  Analytic  techniques  for  the  assessment  of 
operator  workload.  Proceedings  of  the  Human  Factors  Society  31st  Annual 
Meeting  (pp.  368-372)  Santa  Monica,  CA:  The  Human  Factors  Society. 

Hlllyard,  S.  A.,  Hlnk,  R.  P..  Schwent,  V.  L..  &  Picton,  T.  W.  (1973). 

Electrical  signs  of  selective  attention  In  the  human  brain.  Science,  182, 
177-179. 

Hlrschfeld,  R.,  &  Bleger,  G.  (1981,  June).  Instrumentation  and  software  for 
the  collection,  analysis,  and  interpretation  of  eve  movement  data  during 
reading  (Tech.  Rep.  Ho.  3).  Ithaca,  HY:  Cornell  University,  Department 
of  Education,  State  College  of  Agriculture  &  Life  Sciences. 

Hlscock.  M.  (19?7).  Pye-moveraent  asymmetry  and  hemispheric  function:  An 

examination  of  individual  differences.  Journal  of  Psychology,  97,  49-52. 

Holtzman,  J.  D.,  &  Gazzanlga,  M.  s!  (1982).  Dual  task  Interactions  due 

exclusively  to  limits  In  processing  resources.  Science,  218,  1325-1327. 

Hord,  D.  J.  (1986).  Endogenous  ERP  components  associated  with  performance  In 
sonar  operators:  I.  Reliability  and  relation  to  training  (Rep.  Mo. 

86-35).  San  Diego,  CA:  Naval  Health  Research  Center,  Naval  Medical 
Research  and  Development  Command. 

Horst,  R.  L.,  Munson,  R.  C. ,  6  Ruchkln,  D.  S.  (1985).  Processing  information 
derived  from  event  related  {otentlal  measures  In  a  monitoring  task. 
Proceedings  of _t  he_  Human  Factors  Society _ 28th  Annual  _Meet tng .  Sant  a 
Monica,  CA:  Human  Factors  Soc  lety. 

Horst,  R.  L..  Munson.  R.  C..  Huchkin,  U.  S.  (1984).  Event  related  potential 
indices  of  workload  in  a  sing!1  task  paradigm.  Proceedings  of  the  28th 
Annual  Meeting  of  the  Human  Factors  Society  (pp.  727  731).  San  Antonio, 

TX:  Human  Factors  Society. 

Hutchins,  C.  U.  (1974).  A  computer  aided  function  allocation  and  evaluation 
system  (CAFES).  Proceedings  of  the  Human  Factors  Society  1 8_th  Annual 
Meet Ing  (pp.  350  353).  Santa  Monica:  Human  Factors  Society. 

Hutt.  I..  U.,  6  Anderson,  J.  P.  (1967).  The  relationship  between  pupil  size  and 
recognition  threshold.  Psychonomlc  Science,  9(8),  177  478. 

lsrcal,  J.  B.,  Chesney,  G.  I..,  Vlckons,  C.  D. ,  6  Donchln,  K.  (1980).  P300  and 

tracking  difficulty:  Evidence  for  multiple  resources  In  dual  task 
performance.  Psychophy s lo logy ,  17.  259  273. 

Israel,  J.  B. ,  Vickens,  C.  D.,  6  Donchln,  E.  (1979).  The  event  related  brain 
potential  as  a  selective  index  of  display  load.  Proceedings  of  the  23rd 
Annual  Meeting  of  the  Human  Factors  Society  (pp.  558  562).  Human  Factors 
Society. 


9? 


Jensen.  R.  s.,  &  Chappell,  S.  L.  (1984).  Pilot  performance  and  workload 

assessment:  An  analysis  of  pilot  errors  (Pinal  Report  for  NASA  Grant  NAS 
2-184).  Moffett  Field,  CA:  National  Aeronautics  and  Space  Administration, 
Ames  Research  Center. 

Jex,  H.  R.  (1982).  Measuring  pilot  workload:  Problems,  progress,  and 
promises.  In  M.  L.  Prazler  &  R.  B.  Cromble  (Eds.),  Proceedings  of  the 
Workshop  on  Flight  Testing  to  Identify  Pilot  Workload  and  Pilot  Dynamics 
(AFPTC-TR-82-5)  (pp.  216-221).  Edwards  Air  Force  Base,  CA:  Ait  Force 
Flight  Test  Center.  (OTIC  No.  AD-A129  333) 

Jex,  H.R.,  &  Clement,  W.P.  (1978).  Defining  and  measuring  perceptual -motor 
workload  in  manual  control  tasks  (STI  Tech.  Rep.  1104-1).  Hawthorne,  CA: 
Systems  Technology.  Inc. 

Johnson,  D.  F. .  6  Haygood,  R.  C.  (1984).  The  use  of  secondary  tasks  in 
adaptive  training.  Human  Factors.  26,  105-108. 

Johnson,  L.  C.  (1970).  A  psychophysiology  for  all  states.  Psychophysiology, 
6(5).  501  516. 

Junker,  A.  M. .  &  Peio,  K.  J.  (1984,  September).  In  search  of  a  visual  cortical 
describing  function:  A  summary  of  work  in  progress.  Proceedings  of  the 
20th  Annual  Conference  on  Manual  Control,  Volume  I  (pp.  37-54). 

Washington.  DC:  National  Aeronautics  and  Space  Administration  (NASA  CP 
2341) . 

Kahneman,  0.,  6  Beatty.  J.  (1966,  December).  Pupil  diameter  and  load  on 
memory.  Science.  154,  1583-1585. 

Kahneman,  D.  I...  6  Heatty,  J.  (1967).  Pupillary  responses  in  a  pitch 
discrimination  task.  Perception  &  Psychophysics.  2.  101  105. 

Kahneman,  D.,  Peavler,  w.  S.,  6  Onuska,  L.  (1968).  Effects  of  verbal  i /.at  ion 
and  incentive  of  the  pupil  response  to  mental  activity.  Canadian  Journal 
of  Psycho logy /Rev.  Canad lan  Psychology .  22(3),  186  196. 

Kahneman.  0.,  Tursky,  B..  Shapiro,  D.,  &  Crider,  A.  (1969).  Pupillary  heart 
rate  and  skin  resistance  changes  during  a  mental  task.  Journal  of 
Experimental  Psychology.  79(1).  164  167. 

v  -.h/.Mman ,  D.,  &  Wright,  P.  (1971).  changes  of  pupil  size  ard  rehearsal 

strategies  in  a  short  term  memory  task.  Quarterly  Journal  of  Experimental 
Psychology,  23,  187  196. 

Kantowltz,  B.  H.  (1986).  A  theoretical  approach  to  measuring  pilot  workload 
(Final  Report  for  NASA  Grant  NCC  2-228).  Washington,  U.  C. :  National 
Aeronautics  Ji„l  Sp/ce  ftdrlnlstrat  icr.. 

Kantowltz,  B.  H.,  6  knight,  J.  L. ,  Jr.  (1976).  Testing  tapping  time  sharing: 
II.  Auditory  secondary  task.  Acta  Psycholog  lea.  40 ,  343  362. 


Kantowitz,  B.  H. ,  Hart,  S.  G. ,  &  Bortolussl,  M.  K.  (1983).  Measuring  pilot 
workload  in  a  moving  base  simulator:  I.  Asynchronous  secondary 
choice -react ion  task.  Proceedings  of  the  Human  Factors  Society  27th 
Annual  Meeting  (pp.  319-322).  Santa  Monica:  Human  Pactors  Society. 

Kantowitz,  B.  H. ,  Hart,  S.  G. ,  Bortolussl,  M.  R.,  Shively,  R.  J.,  &  Kantowitz, 
S.  C.  (1984).  Measuring  pilot  workload  in  a  moving  base  simulator:  II. 
Building  levels  of  workload.  Proceedings  of  the  20th  Annual  Conference  on 
Manual  Control  (pp.  359-371).  (NASA  CP-2341). 

Kantowitz,  B.  H..  &  Weldon,  M.  (1985).  On  scaling  performance  operating 
characteristics:  Caveat  Emptor.  Human  Pactors.  22(5),  531-547. 

Kaufman,  L.,  &  Williamson,  S.  J.  (1983,  April).  Neuromagnetlc  investigation  of 
workload  and  attention  (APOSK  TR-83-0901) .  Bolling  Air  Force  Base,  DC: 

Air  Force  office  of  Scientific  Research.  (NTIS  No.  AD  A136172) 

Keesey,  U.  T.,  &  Nichols,  D.  J .  (1967).  Fluctuations  in  target  visibility  as 
related  to  the  occurrence  of  the  alpha  component  of  the  electro¬ 
encephalogram.  Vision  Research,  7,  859-877. 

Kilmer,  W.  L.  (1969,  February).  The  reticular  formation  Part  II:  The  biology 
of  the  reticular  formation  (Interim  Rep.  No.  3).  Arlington,  VA: 

Directorate  of  Information  Sciences,  Air  Force  Office  of  Scientific 
Research.  (NTIS  No.  AD  685731) 

Kim,  W. ,  Zangemelster,  V. ,  &  Stark,  I..  (1984,  September).  No  fatigue  effect  on 
blink  rate.  Proceedings  of  the  20th  Annual  Conference  on_  Manual^  Cont  r_oi 
Volume  I  (pp.  337  348) .  Moffett  Field,  CA:  Ames  Research  Center. 

Kinney,  J.  S.,  McKay,  C.  L. ,  Mensch,  A.,  6  l.uria,  S.  M.  (1971,  October). 

The  visual  evoked  cortical  response  as  a  .measure  of  stress  in  naval 
environments:  Methodology  and  analysis  (2)  rapid  flash  rates  (Rep.  No. 

681).  Groton,  CT:  U.S.  Naval  Submarine  Medical  Center,  Navy  Department. 

Kirkpatrick,  M.  Ill,  Malone,  T.  B.,  6  Andrews,  P.  J.  (1984).  Development  of  an 
interactive  microprocessor  based  workload  evaluat Ion  model  (SIMWAM). 
Proceedings  of  the  Human  Factors  Society  28th  Annual  Meeting  (pp.  78  80). 
Santa  Monica:  Human  Pactors  Society. 

Klapp,  S.  T..  Kelly,  P.  A.,  Uattlsto,  V.,  6  Dunbar,  (1984).  Types  of 

tracking  errors  induced  by  concurrent  secondary  manual  task.  Proceedings 
of  the  20th  Annual  Conference  on  Manual  Control  (pp.  299  304).  (NASA 
CP  2341). 

Kobus,  D.  A.,  Beeler,  M.  J.,  6  Stashower,  K.  (  1987,  February),  gleet ro 
physiological  effects  of  uxpbi  ience  d..r*.r.q  jn  auditory  task  (Rep.  *o. 

87-2).  San  Diego,  CA:  Naval  Health  Research  Center. 

Kozlcharow,  K.  (1984,  February  20).  Research  alms  at  reducing  pilot  stress. 
Aviation  Week  6  Space  Technology,  p.  75. 


94 


Kramer,  A.  P.,  &  Wlckens,  C.  D.  (1985).  Event-related  brain  potentials  and 
resource  allocation:  Proa  dual-task  decrements  to  dual-task  Integrality. 
Proceedings  of  the  Human  Pactors  Society  29th  Annual  Meeting  (pp. 

966-970).  Santa  Monica:  Human  Pactors  Society. 

Kramer,  A.  p.  Event  related  brain  potentials.  In  A.  Gale  &  B.  Christie 

(Eds.),  Psychophysiology  and  the  electronic  workplace.  Sussex,  England, 
vl ley.  In  press. 

Kramer,  A.  P.,  Slrevaag,  E.  J. ,  6  Braune.  K.  (1987).  A  psychophysio log leal 
assessment  of  operator  workload  during  simulated  flight  missions.  Human 
Pactors,  29(2),  145-160. 

Kramer.  A.  P..  Wlckens,  C.  0.,  &  Donchln,  E.  (1983).  An  analysis  of  the 
processing  requirements  of  a  complex  perceptual  motor  task.  Human 
Pactors,  25(6),  597-621. 

Krelfeld):,  J.  G.  (1983).  Simulation  fidelity  and  numeroslty  effects  In  COT I 
experimentation  (Rep.  No.  166459,  pp.  17).  Medford,  MA:  National 
Aeronautics  and  Space  Administration. 

Krlvohlavy,  J.,  Kodat,  V.,  &  Cizek,  P.  (19*9).  Visual  efficiency  and  fatigue 
during  the  afternoon  shift.  Ergonomics,  1^(5),  735  740. 

Krueger,  G.  P.,  &  Eng  lurid,  C.  E.  (1985).  Methodological  approaches  to  the 

study  of  sustained  work/sustained  operations.  BehavJor_  Research  .Methods ,_ 

1 nst  ruments,  6  Computers ,  17(6).  587  591. 

Krzanowskl,  V.  J . .  6  Nicholson,  A.  N.  (1972).  Analysis  of  pilot  assessment  of 
workload.  Aerospace  Medicine.  43(9),  993  997. 

halehzo*  ian,  H.  (1988).  Mental  workload  and  P300  component  of  event  related 
brain  potentials  in  a  visual  monitoring  task.  Proceedings  of  the  Human 
Pactors  Society  32nd  Annual  Meeting  (pp.  1404  1408).  Santa  Monica,  CA: 

Human  Factors  Society. 

1, amber t ,  K.  H  ,  Monty,  K.  A.,  6  Hall,  R.  J.  (  1974  ).  High  speed  data  processing 
and  unobtrusive  monitoring  of  eye  movements.  Behavior  Research  Methods  6 
Inst  rumen tar  Ion,  (6),  525  530. 

bane,  N.  K. ,  6  Gtrieb,  M.  I.  (1977).  The  human  operator  simulator:  Workload 
estimation  using  a  simulated  secondary  task.  Cologne.  Federal  Republic  of 
i  Germany:  AGARD  Conference  Proceedings  No.  216  (pp.  All.O  11.12).  Advisory 

Group  for  Aerospace  Research  6  Development. 

l.atour,  P.  L.  (1966).  Cortical  control  of  eye  movements.  Institute  for 
perception  RVO  TNO,  National  Defence  Research  Organization  TNO. 

Goesterbcig,  The  Netherlands.  (NTIS  No.  AD  804078) 

l^vlson,  V.  H.  (1982).  The  optimal  control  model  for  the  human  operator: 
Theory,  validation,  and  application.  In  M.  L.  Frazier  &  R.  B.  Crombie 
( Eds . ) .  Proceedings  of  the  Workshop  on  Flight  Testing  to  Identify  Pilot 
Workload  and  Pilot  Dynamics  (AFFTC-TR  82  5)  (pp.  551  579).  Edwards  Air 
Force  Base.  CA:  Air  Force  Flight  Test  Center.  (OTIC  No.  AD  A129  333) 


95 


Lewis,  G.  V.  (1983).  Event  related  brain  electrical  and  magnetic  activity: 
Toward  predicting  on- job  performance.  International  Journal  of 
Meurosclence.  18.  159-182. 

Lewis,  G.  V.  (1983,  November).  Bioelectric  predictors  of  personnel 

performance:  A  review  of  relevant  research  at  the  Maw  Personnel  Research 
and  Development  Center  (NPRDC  TK  84-3).  San  Diego.  CA:  Naval  Personnel 
Research  and  Development  Center. 

Lewis,  G.  w. ,  8  Pronlng.  J.  N.  (1981).  Sensory  interaction,  brain  activity, 
and  reading  ability  In  young  adults.  International  Journal  of 
Neuroscience.  15,  129-140. 

Linde,  C. ,  &  Shively,  R.  J.  (1988).  Field  study  of  communication  in  police 
helicopters:  Implications  for  A1  cockpit  design.  Proceedings  of  the 
Human  Pactors  Society  32nd  Annual  Meeting  fpp.  237-241).  Santa  Monica, 

CA:  Human  Pactors  society. 

I.indholm,  E.,  Cheatham,  C.,  8  Buckland,  G.  (1981).  Physiological  and  dual 
task  assessment  of  workload  during  tracking  and  simulated  flight 
(TR  82-0714).  Terape:  Arizona  State  University.  (DTIC  No.  AD-A119  218). 

I.indholm,  E..  Cheatham,  C..  Koriath,  J.,  8  Longr idqe ,  T.  M.  (1984). 

Physiological  assessment  of  aircraft  pilot  workload  in  j$imu la ted  landing 
and  simulated  hostile  threat  environments  (afhkl  TR  83  49).  Brooks  A KM, 

TX:  Air  Force  Human  Resources  Laboratory.  (DTIC  No.  AD  A140  469). 

I.indholm,  E. ,  Cheatham.  G. ,  8  Koriath,  J.  (1984,  April).  Physiological 

assessment  of  aircraft  pilot  workload  in  simulated  landing  and  .stimulated 
hostile  threat  environments  (AFHKL  TK  83  49).  williams  Air  Force  Base, 

AZ:  Operations  Training  Division.  Mr  Fore,-  Systems  Command.  (NTl'.i  No.  AD 

A140469) 

I.indholm,  E. ,  Sisson,  N.,  Miller,  M.  J.,  8  Toldy,  M.  K.  (1987,  April). 

Physiological  assessment  of  pilot  workload  in  the  A7  aircraft  (Final 
Rep.,  Contract  AFHKL  TP  86  25).  Williams  Air  Force  Base.  A7. :  Air  Forte 
Human  Resources  Laboratory. 

I.indsley,  0.  B..  8  Hunter,  V.  S.  (  1939).  Note  on  polarity  potentials  from,  the 
human  eye.  National  Academy  of  Science,  25,  180  183. 

Linton,  P.  M.  (1977,  April),  operator  workload  assessment  model:  An  evaluation 
of  a  VF/VA  V/STOL  system.  Cologne,  Federal  Republic  of  Germany:  AGAKD 
Conference  Proceedings  No.  216  (pp.  A12.1  12.12).  Advisory  Group  for 
Aerospace  Research  8  Development. 

Lion,  K.  3.,  8  Brockhurst,  R.  J.  (1951).  Study  of  ocular  movements  under 
stress.  Amertcan  Journal  of  Ophthalmology,  46,  315  318. 

Lorens,  S.  A.,  Jr.,  8  Darrow,  C.  W.  (1962).  Bye  movements,  EEC,  GSR  and  KKG 
during  mental  multiplication.  Electroencephalography  and  Clinical 
Neurophysiology .  14,  739-746. 


96 


Lubln,  A.,  Johnson,  L.  C.,  &  Austin,  M.  T.  (1969).  Discrimination  among  states 
of  consciousness  using  EBG  spectra.  Psychophysiology.  5(2),  122-132. 

Lyman,  J.  (1986).  Modified  Petri  net  model  sensitivity  to  workload 

manipulations  (Pinal  Report  for  NASA  Grant  NAG  2-216).  Washington,  D.C.: 
National  Aeronautics  and  Space  Administration. 

Mack,  A.,  &  Kerman,  B.  (1972).  A  new  illusion:  The  underestimation  of  distance 
during  pursuit  eye  movements.  Perception  &  Psychophysics.  12(6),  471-473. 

Madnl,  A.  M.,  &  Lyman,  J.  (1983).  Model-based  estimation  and  prediction 

of  task-imposed  mental  workload.  Proceedings  of  the  Human  Factors  Society 
27th  Annual  Meeting  (pp.  314-318).  Santa  Monica:  Human  Factors  Society. 

Magllero,  A.,  Bashore,  T.  R.,  Coles,  M.  G.  H.,  6  Donchin,  E.  (1984).  On  the 
dependence  of  P300  latency  on  stimulus  evaluation  processes. 
Psychophysiology* .  21(2).  171-186. 

Malkoff,  D.  B.  (1984).  Biotechnology  predictors  of  physical  security  personne 1 
performance:  Cerebral  potential  measures  related  to  stress  (NPRDC  TR84 
23).  San  Diego.  CA:  Naval  Personnel  Research  and  Development  Center.  (NT1S 
No.  AD  A l 39528) 

Malrr.strom,  F.  V.,  Randle,  K.  J.,  Murphy,  M.  K.,  Reed,  I..  K.,  6  Weber,  R.  J. 
(1981;.  visual  fatigue:  The  need  for  an  Integrated  model.  Bulletin  of 
the  Psychonomlc  Society ,  17(4).  1 8 3  1 86  . 

Malmstrom,  F.  W.,  Reed,  L.  K.,  6  Randle,  K.  J.  (1983).  Restriction  of  pursuit 
eye  movement  range  during  a  concurrent  auditory  task.  Journal  of  Applied 
Psychology.  68(4).  565  571. 

Mane,  A..  6  Wlckens,  C.  D.  (1986).  The  effects  of  task  difficulty  and 
workload  in  training.  Proceedings  of  the  Human  Factors  Society  30th 
Annual  Meeting  (pp.  1124  1127).  Santa  Monica:  Human  Factors  Society. 

Mathews,  M.  L.  (1986).  The  Influence  of  visual  workload  history  on  visual 
performance.  Ihjman_ Factors,  28(6).  621  612. 

Matsuoka,  K..  k  Ueda,  Y.  (1986).  Frequency  character  1st les  of  the  smooth 

pursuit  component  In  tracking  eye  movements.  Ergonomics.  29(2),  197  214. 

McBride,  D.  K.,  Goodman.  L.  S..  k  Owens,  J.  M.  (1985,  February).  Simple  and 
choice  reaction  time  In  a  secondary  task  under  varied  stimulus  modality 
probabilities  (NAMKL  1313).  Bethesda,  MD:  Naval  Aerospace  Medical 
Research  Laboratory,  Naval  Medical  Command.  (NTIS  No.  AD  A159698) 

McCormack.  P.  D. ,  Haltrecht.  K.  J..  k  Hannha,  T.  E.  (1966).  Monitoring  eye 
movements  In  nonlearning  situations.  Psychonomlc  Science.  6,  371  372. 

Melvlll  Jones,  G.,  6  Free,  W.  T.  (I960.  September).  A  method  for  simultaneous 
measurement  of  eye  movements  abou t.  three  or thogonal  axes  ( FPRC / 1 1 56 ) . 
Farnborough,  Hants,  P.ngland:  Flying  Personnel  Research  Committee,  RAP 
Institute  of  Aviation  Medicine. 


97 


Merchant,  J..  Morrlssette,  R.,  &  Porterfield,  J.  L.  (1974,  July).  Remote 
measurement  of  eye  direction  allowing  subject  motion  over  one  cubic  foot 
of  space.  IEEE  Transactions  on  Biomedical  engineering,  BME  21(4) , 

309-317,  IEEE. 

Meredith,  M.  A.,  &>  Stein,  B.  E.  (1985,  February).  Descending  efferents  from 
the  superior  colliculus  relay  Integrated  multlsensory  information. 

Science,  227,  657-659. 

Mertens.  H.  W.,  Hlqqens,  E.  A..  &  McKenzie,  J.  M.  (1983).  Age,  altitude, 
and  workload  effects  on  complex  performance  (FAA-AM-83- 15) .  Washington, 
D.C.:  Federal  Aviation  Administration,  Office  of  Aviation  Medicine.  (DTIC 
No.  AD-A133  594). 

Metzler,  T.  R.  (1986).  Register  of  research  In  progress  on  mental  workload 
(AAMKL  TR-86  007).  Wright  Patterson  AFB,  OH:  Armstrong  Aerospace  Medical 
Research  Laboratory.  (DTIC  No.  AD-A168  210). 

Metzler.  T.  R.,  t,  Shlngledecker ,  C.  A.  (1982,  July).  Register  of  research  In 
progress  of  mental  workload  (APAMRL  TR-82  42).  Wright  Patterson  Air  Force 
Base,  OH:  Air  Force  Aerospace  Medical  Research  Laboratory,  Air  Force 
Systems  Comma nr  J . 

Miles,  W.  K.  (  1939).  Kxper imental  mod  1 f leaf  Ion  of  the  polar rity  potential  of 
the  human  eye.  Yale  Journal  of  Biology  and  Medicine,  12,161  183. 

Miller,  J.  C.,  6  Reader,  U.  C.  (1982,  May).  Physiological  and  performance 

parameters  as  Indices  of  pilot  workload:  An  analysis  of  data  from  the  AFTl 
F  16  project.  Proceedings  of  the  Aerospace  Medical  Association  (pp. 

155  158).  Hal  Harbour,  FI.:  Aerospace  Medical  Association. 

Miller,  R.  C.  .  Hart,  S .  c, .  (1981).  Assessing  the  subjective  workload  of 
directional  orientation  tasks.  Twentieth  Annual  Conference  On  Manual 
Control  (Rep.  No.  NASA  CP  2341,  pp.  85  96).  Moffett  Field,  CA:  National 
Aeronautics  and  Space  Administration. 

Miller.  R.  C.,  Hortolus.sl,  M.  R.,  6  Hart,  S.  G.  (  1986).  Kvaluatlng  the 
subjective  workload  of  directional  orientation  tasks  with  varying 
displays.  Fifth  Aerospace  Behavioral  Engineering  Technology  Conference 
Proceedings  (pp.  135  138).  Warrendale,  PA:  Society  of  Automotive 
Engineers . 

Mixon,  T.  R.,  &  Moroney,  W.  K.  (1982).  An  annotated  bibliography  of  objective 
pilot  performance  measures  ( NAVTKAKpu l PCKN  IH  330).  Orlando,  FL:  Naval 
Training  Equipment  Center. 

Mocharnuk,  J.  B.  (1978).  Visual  target  acquisition  and  ocular  scanning 
performance.  Human  Factors,  20(5),  611-631. 

Molse,  S.  L.,  Jr.  (1985).  An  investigation  of  the  use  of  steady  state  evoked 
potentials  for  human  performance _and^ work Ipadasscssment  and  contro 1  (Rep. 
No.  F49620  83C  0102,  pp.  I  66).  Bolling,  AFB,  Washington,  DC:  Mr  Force 
Office  of  Scientific  Research. 


98 


Moray,  N.  (1982).  Subjective  mental  workload.  Human  Factors.  24(1),  25-40. 


Moray,  N.  (1984,  May).  Mental  workload.  Proceedings  of  the  1984  Interna¬ 
tional  Conference  on  Occupational  ergonomics.  Volume  2:  Reviews  (pp. 

41-46).  Toronto,  Canada. 

Moray,  N.  (1979).  (Bd.).  Mental  workload:  Its  theory  and  measurement. 

New  York:  Plunum  Press. 

Moray,  N.  (1980).  Subjective  measurement  of  mental  workload  (Tech.  Rep.  for 
Contract  No.  N00014-77-C-0256) .  Cambridge:  Massachusetts  Institute  of 
Technology.  (DTIC  NO.AD-A092  664). 

Moray.  N.,  Kruschelnlcky,  E.,  Eisen,  P. ,  Money.  L.,  &  Turksen,  I.  B.  (1988). 

A  fuzzy  set  analysis  of  skill,  rule  and  knowledge  based  workload. 
Proceedings  of  the  Human  Factors  Society  32nd  Annual  Meetln  (pp.  164-167). 

Moray,  N..  Turksen.  B.,  Aidle,  P.,  Orascic.  D..  Risen,  P.,  Kruschelnlcky,  E . , 
Money.  L..  Schonert,  H.,  6  Thornton,  C.  (1986).  Progress  In  mental 
workload  measurement.  Proceed lngs  of  the  Human  Factors  Society  30th 
Annual  Meeting.  2.  1121  1123. 

Mulder.  O.  (1979).  Mental  load,  mental  effort  and  attention.  In  N.  Moray 
(Ed.).  Mental  work  loath.  Jts  theory  and  measurement.  New  York:  Plenum 
Press . 

Murphy,  M.  K.,  Randle.  K.  J.,  Tanner.  T.  A.,  Frankel,  K.  M. ,  Goguen,  J.  A., 

6  l.inde,  C.  (1984).  A  full  mission  simulator  study  of  aircrew 
per formance .  The  measure  of  crew  roord inat Ion  and  decisionmaking  factors 
and  thei'  relationships  to  flight  task  performance.  Proceedings  of  the 
20th  Am  il  Conference  on  Manual  J.'ont ro l  (NASA  CP  2341  ),  2.  249  260. 

Nakayama ,  K.,  6  Mackeben,  M.  (1984,  November).  The  or_lgtn  of  brain  potentials 
associated  with  selective  visual .attention  ( AROSE  TK  85  0246).  Bolling 
Air  Force  Base,  DC:  Air  Force  Office  of  Scientific  Research.  (NTIS  No.  AD 
A152291  ) 

Narayan,  V.  (1985,  October).  Ocwhjmotor  pet  formance*  ar.d  visual  fatigue. 
Dissertation  Abstracts  1 ntor na ti ona l ,  46(4). 

Nataupsky.  M.,  Pope.  A.  T.,  McManus,  M.  t...  Burdette,  D.  X.  (1988).  Workload 
evaluations  of  a  stereo  3  D  computer  generated  pictorial  primary  flight 
display.  Proceed lngs  of  the  Human  Factor s  Soc 1 ej y  32nd  Annua l  Mee ting 
(pp.  162-163).  Santa  Monica,  CA:  Human  Factors  Society. 

Nataupsky,  M. ,  Schwank,  J .  C.  H.,  Griggs,  K.  B.,  McKay,  K.  K.,  Jr.,  6 

Schmidt,  S.  D.  (1979,  November).  Effect  of  pretraining  criterion  on 
flight  simulator  and  secondary  cognitive  task  performance.  Proceedings  of 
the  23rd  Annual  Meeting  of  the  Human  Factors  Society  (pp.  305  309). 

Boston,  MA. 


National  Aeronautics  and  Space  Administration,  Ames  Research  Center.  (1986). 
NASA  workload  consultant  for  field  evaluation  (VC  FIELDS) .  Moffett  Field, 
CA:  Author. 

Navron,  0.,  &  Gopher,  D.  (1977).  On  the  economy  of  the  human  processing 

system:  A  model  of  multiple  capacity.  Haifa,  Israel:  Technion  Tech.  Rep. 
AFOSR-77- l .  (NTIS  No.  AO  A05957S) 

Navon,  D.,  &  Gopher,  0.  (1979).  On  the  economy  of  the  human  processing 
systems.  Psychological  Review.  86,  214-255. 

Nechayev,  A.  P.,  Ponomareva,  I.  P.,  Khldeg,  Y.  A.,  Bognar,  L.,  &  Remesh,  P. 
(1988,  March).  On  the  additional  capacities  of  the  methodology  for 
studying  human  psychological  work  capacity.  USSR  Spafe  Life  Science 
Digest,  15,  56-57. 

Nicholson,  A.  N.  (Ed.).  (1974).  Simulation  and  study  of  high  workload 

9P?L.ai.i9QS  (AOARD-CP- 146) .  Neuilly-sur-Seine,  France:  North  Atlantic 
Treaty  Organlzat Ion- Advisory  Group  for  Aerospace  Research  and  Development. 
(OTIC  No.  AD  A007963 ) 

Nicholson,  A.  N.,  Hill,  L.  E.,  Borland,  R.  G.,  f,  Ferres,  M.  M.  (1970). 

Activity  of  the  nervous  system  during  the  let  down,  approach  and  landing: 

A  study  of  short  durat Ion  high  workload.  Aerospace  Medicine,  41(4), 

416  446. 

Nicholson,  A.  N.,  Hill,  L.  E.,  Borland,  ft.  G. ,  &  Krartowskl,  w.  J.  (1973). 
Influence  of  workload  on  the  neurological  state  of  a  pilot  during  the 
approach  and  landing.  Aerospace  Medicine.  44(2),  146  162. 

Nicholson,  A.  N.,  Stone,  B.  M. ,  Borland,  R .  ,  6  spencer.  M.  b.  (  1983, 

April).  Adaptation  to  irregularity  of  rest  and  activity.  Neuilly  sur 
Seine,  France:  AGARD  Conference  Proceedings  No.  338  ( pp .  12. I  12.6). 
Advisory  Group  for  Aerospace  Research  &  Development.  (NTIS  No.  AD  A139324) 

Soda,  H.,  6  Adey,  W.  R.  (1974).  Excitability  changes  In  cat  lateral  geniculat 
cells  during  saccadic  eye  movements.  Science.  183,  643  646. 

Noda,  M.,  Freeman,  R.  B.,  Jr.,  &  Creutzfeldt,  O.  D.  (1972).  Neuronal 

correlates  of  eye  movements  in  the  visual  rotten  of  the  cat.  Science. 

176.  661  664. 

Norman,  D.  A.,  6  Babrow,  D.  G.  (1975).  On  data  limited  and  resource 
limited  processes.  Cognitive  Psychology,  7,  44  64. 

North,  R.  A.  (1977,  January).  Task  components  and  demands  as  factors  in  dual 
task  performance  (AFOGK  77  2).  Savoy,  It.:  University  of  Illinois  at 
Urbana  Champaign. 

North,  K.  A.,  6  Gopher,  D.  (1976).  Measures  of  attention  as  predictors  of 
flight  performance.  Human  Factors,  1J8 ,  l  14. 


North.  R.  A.,  &  Graffunder,  K .  (1979).  evaluation  of  a  pilot  workload  mettle 
for  simulated  VTOL  landing  tasks.  Proceedings  of  the  23rd  Annual  Meeting 
of  the  Human  Pactors  Society  (pp.  357-361).  Boston,  MA. 

North,  R.,  &  Riley,  V.  (1988).  WINDEX:  A  predictive  model  of  operator 

workload.  In  G.  MacMillan  (Ed.),  Human  performance  models.  NATO  AGARD 
Symposium. 

Notestlne,  J.  C.  (1984).  Subjective  workload  assessment  and  effect  of  delayed 
ratings  in  a  probability  monitoring  task.  Proceedings  of  the  Human 
Pactors  Society  28th  Annual  Meeting.  2,  685-689. 

Nunnally,  J.  C.,  Knott,  P.  D.,  Duchnowski,  A.,  6  Parker.  R.  (1967).  Pupillary 
response  as  a  general  measure  of  activation.  Perception  6  Psychophysics, 
2,  149-155. 

Oatman,  L.  C.  (1987,  January).  Spectral  analysis  of  cortical  EEC  activity 
during  simultaneous  auditory  and  visual  stimulation  (Tech.  Memorandum 
2-87).  Aberdeen  Proving  Ground,  MD:  Human  Engineering  Laboratory. 

Oatman.  L.  C.  (1987,  September).  Measuring  mental  workload:  A  performance 

battery  (Tech.  Memorandum  Mo.  21  87).  Aberdeen  Proving  Ground,  MD:  Human 
Engineering  laboratory. 

O’Donnell,  K.  D.  (1975).  Secondary  task  assessment  of  cognitive  workload  In 
alternative  cockpit  conf lgurat Ions  (AMKt.  TK  75  49  AGARD  CPP  181).  wrignt 
Patterson  Air  Force  Base,  OH:  Aerospace  Medical  Research  Laboratory. 

O’Donnell,  R.  D.  (1976,  April).  Secondary  task  assessment  of  cognitive  work 
load  In  alternative  cockpit  configurations.  In  B.  0.  Hartman  (Kd.), 

Higher  mental  functioning  In  operational  environments.  AGARD  Conference 
Proceedings  Mo.  181,  C  10.  (NTIS  No.  Al>  A025663) 

O'Donnell,  R.  D.  (1979).  Contributions  of  psychophys io log  lea  1  techniques  to 
aircraft  design  and  other  operational  problems.  Neullly  sur  Seine, 

France:  AGARD  Conference  Proceed  trigs  No.  244. 

O'Donnell,  R.  D.  (1981).  Development  «,f  a  neurophysiological  test  battery  for 
workload  assessment  Irt  the  U.S.  Air  Force.  Proceedings  of  the  Inter 
nat Iona  1  Conference  on  Cybernet l cs  and  Society  (pp.  798  402).  IEEE, 
Atlanta,  GA. 

O'Donnell,  R.  D.  (1983,  April).  The  U.G.  Air  Force  neurophysiological 

■workload  test  battery:  Concept  and  validation.  Neullly  sur  Seine,  France: 
AGARD  Conference  Proceedings  No.  338  (pp.  5.1  5.10).  North  Atlantic 
Treaty  Organization  Advisory  Group  for  Aerospace  Research  6  Development. 
(NTIS  No.  AD  Al 39324 ) 

O'Donnell,  R.  D.,  6  Eggemler.  F.  T.  (1983,  April).  Conceptual  framework  for 
the  development  of  workload  metrics  In  sustained  operations.  Neullly  sur 
Se 1 ne ,  France :  AGARD  Conf orence  proceed lrtgs  No.  338  ( pp .  4.1  4.10). 
Advisory  Group  for  Aerospace  Research  6  Development.  (NTIS  No.  AD  A139724) 


101 


O'Donnell,  R.,  Eggemeler,  F.  T.  (1986).  Workload  assessment  methodology.  In 
K.  R.  Boff,  L.  Kaufman  fc  J.  P.  Thomas  (Eds.)  Handbook  of  perception  and 
human  performance.  Vol.  II.  cognitive  processes  and  performance.  John 
Wiley  and  Sons. 

O'Donnell,  R.  D.,  &  shlngledecker ,  C.  A.  (1986,  July).  Behavioral  and 

physiological  monitoring  and  prediction  of  operator  status  and  capability 
(Final  Rep.  Contract  Wo.  DM©  17-86-C-6114) .  Dayton,  OH:  Universal  Energy 
Systems,  Inc. 

Palvlo,  A.,  &  Simpson,  H.  N.  (1966).  the  effect  of  word  abstractness  and 
pleasantness  on  pupil  size  during  an  Imagery  task.  Psychonomlc  Science, 
5(2),  55-56. 

O'Donnell,  R.  D. ,  &  Splcuzza,  R.  J.  (1975).  Pilot  performance  assessment  In 
systems  using  Integrated  digital  avionics.  Proceedings  of  the  46th  Annual 
Meeting  of  the  Aerospace  Medical  Association.  San  Francisco,  CA: 

Aerospace  Medical  Association. 

Offenloch,  K.  (1977,  April).  Neurophys loloq lea  1  assessment  of  functional 
states  of  the  brain.  Proceedings  of  the  AGAKD  Conference  on  Methods  to 
Assess  Wor: load  (AGAKD  CP  216).  pp.  A10  l  A10  4. 

Ogden,  0.  L>.,  l.evtne,  J.  M. ,  &  Eisner,  E.  J.  (1979).  Measurement  of  workload 
by  secondary  tasks.  Human. .Factors,  21 ,  529  548. 

Onstott,  K.  1).  (1976,  May).  Task  interference  In  multi  axis  aircraft 

stabl 1 1/at  ion.  Proceedings  of  the  12th  Annual  NASA  University  Conference 
on  Manual  Control  (NASA  TM  X  73,170).  University  of  Illinois. 

Onstott,  K.  I).,  6  Faulkner,  W.  H.  (1977,  June).  Prediction  of  pilot  reserve 
attentlo/i  capacity  during  air  to  air  target  tracking.  Proceedings  of  the 
13th  Annual  NASA  University  Conference  on  Manual  Control  (pp.  136  142). 
Massachuset t s  Institute  of  Technology. 

Opmcer,  C.  H.  J.  M.  (1973).  The  Information  content  of  successive  KR  interval 
times  in  the  KCG:  Preliminary  results  using  factor  analysis  and  frequency 
analysis.  Ergonomics .  16,  105  112. 

Opmcer,  C.  M.  J.  M. ,  6  Xrol,  J.  P.  (1973).  Towards  an  objective  assessment 
of  cockpit  workload.  1  phys'ologlcal  variables  during  different  flight 
phases.  Aerospace  Medicine,  44.  527  532. 

Owens,  J.  M..  6  Harris.  S.  D.  (1978,  July).  On  the  assessment  of  processing 
demands  in  complex  task  structures  (namki.  1249).  Pensacola,  FL:  Naval 
Aerospace  Medical  Research  Laboratory.  (NTIS  No.  AD  A060317( 

Parasuraman,  R.  (1985).  Event  related  brain  potentials  and  intermodal  divided 
attention.  Proceedings  of  the  Human  Factors  Society  29th  Annual  Meeting. 
2.  971  975. 

Parasuraman,  R.  (1987).  Human  computer  monitoring.  Human  Factors.  29. 

695  706. 


i 


102 


Parasuraman,  R.  (1979,  August).  Memory  load  and  event  rate  control  sensitivity 
decrements  In  sustained  attention.  Science.  205.  924-927. 

Parks,  D.  L.  (1979).  Current  workload  methods  and  emerging  challenges.  In 
M.  Moray  (Ed.),  Mental  workload:  Its  theory  and  measurement  (pp.  387- 
416).  Mew  York:  Plenum. 

Parks,  D.  L.,  &  Springer,  W.  B.  (1976,  January).  Human  factors  engineering 
analytic  process  definition  and  criterion  development  for  Computer-Aided 
Pune tlon-al location  Evaluation  System  (CAPES)  (0180-18750-1).  Seattle. 

WA:  Boeing  Aerospace  Company. 

Pasmoolj,  C.  K.,  Opraeer,  C.  H.  J.  M.,  6  Hyndman,  B.  W.  (1976).  Workload  In 
air  traffic  control.  In  T.  B.  Sheridan  &  G.  Johannsen  (Eds.),  Monitoring 
behavior  and  supervisory  control  (pp.  107-117).  Mew  York:  Plenum. 

Payne,  D.  T. ,  Parry,  M.  E..  6  Harasymlw,  S.J.  (1968).  Percentage  of  pupillary 
dilation  as  a  measure  of  Item  difficulty.  Perception  &  Psychophysics. 

4(3),  139  143. 

Payne.  D.  R.,  &  Buck,  J.  R.  (1979).  Synthetic  switching  time  statistics. 

Proceedings  of  the  23rd  Annual  Meeting  of  the  Human  Factors  Society  (pp. 

201  204),  Boston,  MA. 

Pettyjohn.  P.  S..  McNeil.  R.  J..  Akers.  L.  A..  i  "abet ,  J.  M.  <197/,  April). 

Use  of  Inspiratory  minute  volumes  In  evaluation  of  rotary  and  fixed  winq 
pilot  workload.  Proceedings  of  the  AGARD  Conference  on  Methods  to  Assess 
Workload  (AC.ard  CPP  216,  A9  1  A9  2). 

Pew.  R.  W.  (1979).  Secondary  tasks  and  workload  measurement.  In  N.  Moray 

(Ed.),  Mental  workload:  Its  theory  .and 'measurement  (pp.  23  28).  New  Yotk: 
Plenum. 

Piiatak.  A.  V.  (1973,  December).  Improvement  In  weapon  system  effectiveness 
by  application  of  Identification  methods  for  determining  human, operator 
performance  decrements  under  stress  conditions.  Palo  Alto,  CA:  System 
Control.  (NTIS  No.  AD  A7/38S6) 

Philipp,  U.,  Relche,  D. ,  6  Klrchner.  J.  H.  (1971).  The  use  of  subjective 
rating.  Ergonomics,  14,  611  616. 

'  Phillips,  J.  E.  (1976,  April).  The  feasibility  of  short  Interval  times 

estimation  as  a  methodology  to  forecast  human  performance  of  a  specif  led 
task  ( DARCOW  irc-02  08  76  010).  Texarkana,  TX:  Red  River  Army  Depot, 
p  NTIS  NO.  AD  A0 26 7 27) 

1  Plutchlk,  R.,  6  Petti,  K.  D.  (1964).  Rate  of  learning  on  a  pursuit  rotor  task 

I  at  a  constant  work  rest  ration  with  varying  work  and  rest  periods. 

Perceptual  and  Motor  Skills,  19.  227- 231 . 


103 


Poison.  M.  C..  Friedman,  A. ,  &  Gasklll,  S.  J.  (1981).  Coape tl ton  for  left 
hemisphere  superiority  at  abstract  verbal  Information  processing  (OMR 
Contract  Tech.  Rep.  Mo.  2,  pp.  1-47).  Boulder,  CA:  Department  of 
Psychology,  university  of  Colorado. 

Polt,  J.  M.,  &  Hess,  E.  H.  (1966).  Changes  in  pupil  size  to  visually  presented 
words.  Psvchonoalc  Science.  12(8),  389-390. 

Poock,  G.  K.  (1972).  Using  plpllloaetry  as  an  Indicator  of  an  operator's 
overload.  Proceedings  of  the  Human  Factors  Society  16th  Annual  Meeting, 
pp.  197-198. 

Posner,  M.  I.,  t  Boies,  S.  J.  (1971).  Components  of  attention.  Psychological 
Review,  78.  391-408. 

Posner,  M.  1.,  Crlppln,  P.  J.,  Cohen,  A.,  t  Ratal.  R.  (1986,  December). 

Speed  of  covert  orienting  of  attention  and  express  saccades  (Tech.  Rep. 

Mo.  1).  Arlington,  VA:  Personnel  &  Training  Research  Programs.  Office  of 
Naval  Research. 

Poston,  A.  M.  (1978,  Hay).  A  survey  of  existing  computer  programs  for  aircrew 
workload  assessment  (Technical  Memorandum  13  78).  Aberdeen  Proving  Ground, 
MD:  U.S.  Army  Human  Engineering  Laboratory.  (NTIS  No.  ad  A058518) 

Potter,  S.  S.,  &  Acton.  W.  H.  (1985).  Relative  contributions  of  SWAT 

dimensions  to  overall  subjective  workload  ratings.  Proceedings  of  the 
Third  Symposium  on  Aviation  Psychology  (pp.  231  238). 

Price,  L>.  L .  (1975).  The  effects  of  certain  glmbal  orders  on  target  acqul 
sit  ion  and  workload.  Human  Factors,  17.  571  576. 

Pritsker.  A.  A.  B. ,  Wortman,  D.  B.,  Seum,  C.  S.,  Chubb,  G.  P. ,  6  Seifert.  D.  J. 
(1974,  April).  SAINT:  Volume  I.  Systems  analysis  of  Integrated  network  of 
tasks  (AMKL  TK  73  1 2*> ) .  Wright- Patterson  Air  Force  Base,  OH:  Aerospace 
Medical  Research  Laboratory.  (NTIS  No.  AD  A014843) 

Proceedings  of  the  symposium  on  Man- System  Interface:  Advances  in  Workload 
Study.  (1978).  Washington,  DC:  Air  Line  Pilots  Association. 

Rah lml ,  M.,  6  Wierwtlle,  W.  W.  (1982).  Evaluation  of  the  sensitivity  and 

intrusion  of  workload  estimation  techniques  in  piloting  tasks  emphasizing 
mediat tonal  activity.  Proceedings  of  the  1982  IEEE  Internat tonal 
Conference  on  cybernetics  and  Society  (pp.  593-597). 

Rasmussen.  J.  (1979).  Reflections  on  the  concept  of  operator  workload.  In 
N.  Moray  (Ed.),  Mental  workload:  Its  theory  and  measurement.  New  York: 
Plenum. 

Rault,  A.  (1976).  Pilot  workload  analysts.  In  T.  U.  Sheridan  6  G.  Johannson 
(Eds.),  Monitoring  behavior  and  supervisory  control  (pp.  139  153).  New 
York:  Plenum. 


Rault,  A.  (1979).  Measurement  of  pilot  workload.  In  N.  Moray  (Ed.),  Mental 
workload;  Its  theory  and  measurement  (pp.  417-422).  New  York:  Plenum. 

Rehmann,  J.  T.  (1982).  Cockpit  display  of  traffic  Information  and  the  measure 
of  pilot  workload:  An  annotated  bibliography  (Rep.  No.  DOT/FAA/BM-81-9) . 
Washington,  DC:  U.S.  Department  of  Transportation,  Federal  Aviation 
Administration. 

Rehmann.  J.  T. ,  Stein,  B.  S..  &  Rosenberg,  B.  L.  (1983).  Subjective  pilot 
workload  assessment.  Human  Factors.  25.  297-307. 

Relche,  D..  Klrchner,  J.  H.,  &  Laurlg,  V.  (1971).  Evaluation  of  stress 

factors  by  analysis  of  radio- telecommunications  In  ATC.  Ergonomics.  14. 
603-609. 

Reid,  G.  B.  (1982).  Subjective  workload  assessment:  A  conjoint  scaling 

approach.  Annual  Scientific  Meeting  of  the  Aerospace  Medical  Association 
(pp.  153-154).  Bal  Harbour,  FL:  Air  Porce  Aerospace  Medical  Research 
Laboratory,  Aerospace  Medical  Division,  Wr lght-Pat terson  Air  Porce  Base. 

Reid,  G.  B.  (1985).  Current  status  of  the  development  of  the  subjective  work 
load  assessment  technique.  Proceedings  of  the  Human  Factors  Society  29th 
Annual  Meeting,  l,  220-223. 

Reid,  G.  B.,  6  Colie,  H.  A.  (1988).  Critical  SWAT  values  for  predicting 

operator  workload.  Proceedings  of  the  Human  Factors  Society  32nd  Annual 
Meet lng  (pp.  1415  1418K  Santa  Monica,  CA:  Human  Factors  Socirty. 

Reid.  G.  B..  Kqgemeler ,  F.  T. ,  6  Nygren,  T.  K.  (1982).  An  individual 

differences  approach  to  SWAT  scale  development.  Proceedings  of  the  Human 
Factors  Society  26th  Annual  Meeting,  pp.  639  642 

Reid,  G.  B.,  Kqgemeler,  F.  T.,  6  Shlngledecker ,  C.  A.  (1981).  Application  of 
conjoint  measurement  to  workload  scale  development.  Proceedings  oj[  Jt  he 
Human  Factors  Society  25th  Annual  Meeting  (pp.  522  526). 

Reid,  G.  B.,  Kqgemeler,  F.  T. ,  &  Shlngledecker,  C.  A.  (1982).  Subjective 
workload  assessment  technique.  In  M.  L.  Pra/.ler  6  R.  B.  Crombie  (Kds.). 
Proceedings  of  the  Workshop  on  Flight  Testing  to  Identify  Pilot  Workload 
and  Pilot  Dynamics  (APFTC  TR  82  5,  pp.  281  288).  Edwards  Air  Force  Base, 
CA:  Air  Force  Plight  Test  Center.  (OTIC  No.  AD  A129333) 

Reid,  G.  B.,  Shlngledecker,  C.  A.,  Nygun,  T.  K. ,  6  Bggeneler.  F.  T.  (1961). 
Development  of  multidimensional  subjective  measures  of  workoad. 

Proceedings  of  the  International  Conference  on  Cyternetlcs  and  society 
(pp.  403-406).  Atlanta,  GA:  Air  Force  Aerospace  Medical  Research 
Laboratory,  Human  Engineering  Division.  Wright- Patterson  Air  Force  Base. 

Relslng,  J.  M.  (1972,  February).  The  definition  and  measurement  of  pilot 
workload  (APFDL  TM-72  4-FOR) .  Wright- Patterson  Mr  Force  Base,  OH:  USAF 
Plight  Dynamics  laboratory. 


105 


Repa,  B.  S..  &  Wlerwllle.  w.  W.  (1976,  October).  Driver  performance  In 

controlling  a  driving  simulator  with  varying  vehicle  response  character¬ 
istics.  SAB  Paper  Mo.  760779. 

Repperger,  D.  Rogers,  D.  B.,  Van  Patten,  R.  E. ,  &  Prazler.  J.  (1982). 

A  study  of  task  difficulty  with  a  subjective  rating  scale.  In  M.  L. 

Prazler  &  R.  B.  Cromble  (Eds.),  Proceedings  of  the  Workshop  on  Plight 
Testing  to  Identify  Pilot  Workload  and  Pilot  Dynamics  (APFTC-TR-82-5,  pp. 
499-513).  Edwards  Air  Force  Base,  CA:  Air  Porce  Plight  Test  Center.  (DTIC 
No.  AD  A129333) 

Revesraan,  M.  E.,  6  Roklckl,  S.  M.  (1985).  Assessment  of  SWAT  accuracy. 

Proceedings  of  the  Human  Factors  Society  29th  Annual  Meeting.  I,  183-187. 

Rlngland,  R.  P.,  &  Craig,  S.  J.  (1977,  August).  A  survey  of  piloting  factors 
In  flxed-wlng  V/STOL  aircraft.  In  Atmospheric  Plight  Mechanics 
Conference,  Technical  Papers  (pp.  239-246).  Hollywood,  PL:  American 
Institute  of  Aeronautics  and  Astronautics. 

Robertson,  M.  H.  (1984).  Personality  differences  as  a  moderator  of  mental 
workload  behavior:  Mental  workload  performance  and  strain  reactions  as  a 
function  of  cognitive  complexity.  Proceedings  of  the  Human  Factors 
Society  28th  Annual  Meeting.  2.  690  694. 

Robertson,  M.  M. ,  6  Meshkati,  N.  (1985).  Analysis  of  the  effects  of  two 
individual  differences  class  If Icar Ion  models  on  experiencing  mental 
workload  of  a  computer  generated  task:  A  new  perspective  to  job  design  and 
task  analysis.  Proceedings  of  the  Human  Factors  Society  29th  Annual 
W£§Lt!(!9'  1.  178  186. 

Robinson,  G.  H.  (1979).  Dynamics  of  the  eye  and  bead  during  movement  between 
displays:  A  quallt.,,lve  and  quantitative  guide  for  designers.  Human 
Factors.  21(3).  343  352. 

Roedlnger,  H.  L.  Ill,  Knight,  J.  I...  .Jr.,  6  Kantowltz,  B.  H.  (1977).  Inferring 
decay  In  short  term  memory:  The  Issue  of  capacity.  Memory  and  Cognition, 

5.  167  176. 

Rohmert,  W.  (19/1).  An  international  symposium  on  objective  assessment  of 
workload  In  air  traffic  control  tasks:  Held  at  the  Institute  of 
Arbeltswl.ssenschaft,  The  University  of  Technology,  Darmstadt,  German 
Federal  Republic.  Ergonomics.  1_4,  545  547. 

Rohmert.  W.  (1977,  April).  Determination  of  stress  and  strain  of  air  traffic 
control  officers.  Proceedings  of  the  AGARD  Conference  on  Methods  to 
Assess  Workload  ( AGARD- CPP  216,  A6-1  A6  8). 

Rohmert,  W.  (1979).  Determination  of  stress  and  strain  at  real  work  places: 
Methods  and  results  of  field  studies  with  air  traffic  control  officers. 

In  M.  Moray  (Ed.),  Mental  workload:  Its  theory  and  measurement  (pp. 

423  443),  New  York:  Plenum. 


106 


Rohnert,  V.,  Laurlg,  V.,  Phillip,  U.,  &  Luczak,  H.  (1973).  Heart  rate 
variability  and  work- load  measurement.  Ergonomics.  16,  33-44. 

Rolfe,  j.  M.  (1971).  The  secondary  task  as  a  measure  of  mental  workload. 

In  W.  T.  Singleton,  J.  0.  Pox,  &  D.  Whitfield  (Ed.),  Measurement  of  man  at 
work.  London:  Taylor  and  Francis. 

Rolfe,  J.  M.  (1971).  Multiple  task  performance:  Operator  workload.  Occupa¬ 
tional  Psychology.  45,  125-132. 

Rolfe,  J.  M.  (1973).  Whither  workload.  Applied  Ergonomics.  4.  8-10. 

Rolfe,  J.  M.  (1973).  The  secondary  task  as  a  measure  of  mental  load.  In 
w.  T.  Singleton,  J.  C.  Pox,  &  D.  Whitfield  (Eds.),  Measurement  of  man  at 
work  (pp.  135-148).  London:  Taylor  and  Francis. 

Rolfe,  J.  M.  (1976).  The  measurement  of  human  response  in  man-vehicle  control 
situations.  In  T.  B.  Sheridan  6  G.  Johannsen  (Eds.),  Monitoring  behavior 
and  supervisory  control  (pp.  125-137).  New  York:  Plenum. 

Rolfe,  J.  M. ,  Chappelow,  J.  W.,  Evans,  R.  L. ,  Lindsay,  S.  J .  E . ,  6  Browning, 

A.  C.  (1974,  April).  Evaluating  measures  of  workload  using  a  flight 
simulator.  Proceedings  of  the  AGARD  Conference  on  Simulation  and  Study  of 
High  Workload  Operations  (AGARD  CP  146.  pp.  A4  1  A4  13). 

Rolfe,  J.  M. ,  6  Lindsay,  S.  J.  E.  (1973).  Flight  deck  environment  and  pilot 
workload:  Biological  measures  of  workload.  Applied  Ergonomics,  4,  199  206. 

Roscoe,  A.  H.  (1975).  Heart  rate  monitoring  of  pilots  during  steep  gradient 
approaches.  Aviation,  Space,  and  Environmental  Medicine,  16.  1410  1413. 

Roscoe,  A.  H.  (1976).  Pilot  workload  durtng  stcei ‘  gradient  approaches 

(Technical  Memorandum  No.  TM  FS  78).  Karnborough ,  England:  Royal  Aircraft 
Establishment,  Flight  Systems  Department. 

Roscoe,  A.  li.  (1976).  Use  of  pilot  heart  rate  measurement  in  flight 

ova  1 ua t ion .  Av la t lon,_ Space,  and  Environmental  Med  1  cine ,  47.  86  90 . 

Roscoe,  A.  H.  (Ed.).  (1978,  February).  Assessing  pilot  workload  (AGARD  AG 
233) .  (AD  AOS l  587) 

Roscoe.  A.  H.  (1978,  February).  Physiological  methods.  in  A.  11.  Roscoe 

(Ed),  Assessing  pilot  workload  (AGARD  AG  233,  pp.  23  51).  (NTlli  No.  AD 
AOS  1587) 

Roscoe,  A.  H.  (1978).  Stress  and  workload  in  pilots.  Aviation,  Space,  and 
Environmental  Medicine.  49,  630  636. 

Roscoe,  A.  H.  (1979,  August).  Handling  qualities,  workload,  and  heart  rate. 

In  B.  O.  Hartman  6  R.  E.  McKenzie  (Eds.).  Survey  of  methods  to  assess 
workload  (AGARD  AG  246,  pp.  83-91). 


Roscoe,  A.  H.  (1987).  in-f light  assessment  of  workload  using  pilot  ratings 
and  heart  rate.  In  Practical  Assessment  of  Pilot  Workload  (AGARDograph 
No.  282)  (pp.  78-82).  Neullly-sur-Selne,  Prance:  Advisory  Group  for 
Aerospace  Research  and  Development. 

Roscoe,  A.  H. ,  &  Goodman,  B.  A.  (1973).  An  Investigation  of  heart  rate 
changes  during  a  flight  simulator  approach  and  landing  task  (RAB-TH- 
Av Ionics- 153 ) .  Parnborough,  Hants,  England:  Royal  Aircraft  Establishment. 

Roscoe,  S.  N.  (1974).  Assessment  of  pilotage  error  In  airborne  area  naviga¬ 
tion  procedures.  Human  Factors.  16,  223-226. 

Roscoe,  S.  N.,  &  Couchman,  D.  H.  (1987).  Improving  visual  performance  through 
volitional  focus  control.  Human  Pactors.  29(3).  311-325. 

Rosenberg,  B.,  Rehmann,  J.,  6  Stein,  E.  (1982).  The  relationship  between 
effort  rating  and  performance  In  a  critical  tracking  task  (Rep.  No. 
DOT/PAA/EM-81/13) .  Washington,  DC:  U.S.  Department  of  Transportation, 
Federal  Aviation  Administration. 

Rosenbrock.  F.  (1971).  Hardware  problems  in  ergonomics  measurements. 
Ergonomics,  14.  617-623. 

Rossi,  A.  M.,  Furhman.  A.,  6  Solomon,  P.  (1964).  Sensory  deprivation:  Arousal 
and  rapid  eye  movement  correlates  of  some  effects.  Perceptual  and  Motor 
Skills.  19.  447-451. 

Rotondo.  C.  (1978).  Workload  and  operational  fatigue  in  helicopter  pilots. 
Aviation,  Space,  and  Environmental  Medicine,  49.  430  436. 

House,  w.  B.  (1977).  Human  computer  interaction  in  multitask  situations. 

TREE  Transactions  on  Systems,  Man,  and  Cybernetics,  SMC  7,  384  392. 

Rouse,  W.  B.  (1979).  Approaches  to  mental  workload.  In  N.  Moray  (Ed.), 

Mental  workload:  Its  theory  and  measurement  (pp.  255  262).  New  York: 
Plenum. 

Ryman,  D.  H.,  Naitoh,  P.,  &  Knglund,  C.  E.  Perceived  exertion  under 

conditions  of  substained  work  and  sleep  loss  (Report  No.  87  9,  pp.  I  19). 
San  Diego,  CA:  Naval  Medical  Command  Researach  6  Development . 

Sanders.  A.  F.  (1979).  Some  remarks  on  mental  load,  in  N.  Moray  (Ed.), 

1  Mental  workload:  Its  theory  and  measurement  (pp.  41  77).  New  York:  Plenum. 

Sanders,  A.  P.  (1983,  April).  Some  Issues  In  research  on  effects  of  sustained 
i  work  and  sleep  loss  on  performance.  Neull ly-sur- Seine,  France:  AGARD 

.  conference  Proceedings  No.  338  (pp.  13.1-13.6).  Advisory  Group  for 

Aerospace  Research  fc  Development.  (NT1S  No.  AD  A139324) 

Sanders,  M.  C.,  Burden,  K.  T.,  Jr.,  Simmons,  R.  R..  l-ees,  M.  A..  6  Kimball, 

K.  A.  (1978).  An  evaluation  of  perceptual -motor  workload  during  a 
helicopter  hover  maneuver  (78-14).  Ft.  Rucker,  AL:  U.S.  Army  Aeromedical 
Research  Laboratory. 


108 


Sanders,  M.  G..  Simmons,  R.  R.,  &  Hofmann,  M.  A.  (1979).  Visual  workload 

of  the  pllot/navigator  during  terrain  flight.  Human  Factors.  21,  369-383. 

Sanders,  M.  C..  Simmons,  R.  R.,  Hofmann,  M.  A.,  &  DuBonls,  J.  n.  (1977). 
Visual  workload  of  the  copllot/navigator  during  terrain  flight. 

Proceedings  of  the  Human  Factors  Society  21st  Annual  Meeting  (pp. 
262-266).  Santa  Monica:  Human  Factors  Society. 

Sanders,  M.  S.,  Jankovich,  J.  J.,  &  Goodpaster,  P.  R.  (1974).  Task  analysis 
for  the  lobs  of  train  conductor  and  brakeman  (RDTR-No,  263).  Crane, 
Indiana:  Naval  Ammunition  Depot. 

Saran,  S.  W.,  &  Perelll,  L.  P.  (1982).  Estimating  aircrew  fatigue:  A  technlgue 
with  application  to  airlift  operations  (Rep.  No.  SAM  TK- 82- 21,  pp.  1-26). 
Brooks  Air  Force  Base,  TX:  USAG  School  of  Aerospace  Medicine,  Aerospace 
Medical  Division. 

Savage.  R.  K..  Wlerwllle.  W.  W..  6  Cordes,  R.  E.  (1978).  Evaluating  the 

sensitivity  of  various  measures  of  operator  workload  using  random  digits 
as  a  secondary  task.  Human  Factors.  20,  649  654. 

Sayers,  B.  M.  (1973).  Analysis  of  heart  rate  variability.  Ergonomics,  16, 
17-32. 

Schaefer,  T..  .Jr.,  Ferguson,  J.  B..  Klein,  J .  A.,  6  Kawson,  K.  u .  (  1968). 

Pupillary  responses  during  mental  activities.  Psychonomic  Sc ience.  12(4). 
137  138. 

Schlffler,  R.  J.,  Gelselhart ,  R..  6  Griffin,  J.  C.  (1978).  A  study  of  crew 
task  loading  on  the  C-141  aircraft  (ASD  TK  78  1).  Wright  Patterson  Air 
Porce  Base.  Ohio:  Air  Force  Systems  Command.  (AD  A057  J46) 

Schiffler,  R.  J.,  Gelselhart,  R.,  &  Ivey.  L.  (1976).  Crew  composition  study 
for  an  Advanced  Tanker/Cargo  Aircraft  ( ATCA )  (Asu  TK  76  20). 

Wright  Patterson  Air  Force  Base,  OH:  USAF  Aeronautical  Systems  Division. 

Schlflett,  S.  G.  (1980).  Evaluation  of  a  pilot  workload  assessment  device  to 
test  alternate  display  formats  and  control  stability  variations 
(SY  33R-80).  Patuxent  River,  MD:  US  Naval  Air  Test  Center. 

Schlflett,  S.  G.  (1976).  operator  workload:  An  annotated  bibliography 
(SY  25/6  76).  Patuxent  River,  MD:  US  Navai  Air  Test  Center. 

Schlflett,  S.  G.  (1979).  Voice  stress  analysis  as  a  measure  of  operator 
workload.  Proceedings  of  the  Human  Factors  Society  23rd  Annual  Meeting 
(p.  573).  Santa  Monica:  Human  Factors  Society. 

Schlflett,  S.  G.  (1983).  Theoretical  development  of  an  adaptive  secondary 
task  measure  pilot  workload  for  flight  evaluations.  Proceedings  of  the 
Human  Factors  Society  27th  Annual  Meeting ,  1 ,  602  605 . 

Schlflett.  S.  G.,  &  Lolklth,  G.  J.  (1980,  March).  Voice  stress  analysis  as  a 
measure  of  operator  workload  (TM  79  3  SY).  Patuxent  River,  MD:  Naval  Air 
Test  Center.  Naval  Air  Station. 


109 


Sch  legal.  R.  B.  &  Gil  Hand,  K.  (1986).  To  determine  Che  existence  of  a 

subjective  Measure  of  excessive  mental  workload  in  a  single  cognitive  task 
(Tech.  Report  PO  246442).  Norman:  The  University  of  Oklahoma. 

Schlegel,  R.  B.,  &  Shlngledecker .  C.  A.  (198S).  Training  characteristics 

of  the  criterion  task  set  workload  assessment  battery.  Proceedings  of  the 
Human  factors  Society  29th  Annual  Meeting.  2,  770-773. 

Schmidt,  D.  K.  (1976).  On  modeling  ATC  work  load  and  sector  capacity. 

Journal  of  Aircraft.  13,  531-537. 

Schmidt,  O.  K.  (1978).  A  Queueing  analysis  of  the  air  traffic  controller’s 
work  load.  IBBB  Transactions  on  Systems.  Han,  and  Cybernetics  (pp. 
492-498).  (SMC-8). 

Schmidt,  F.  L.,,  Hunter.  J.  E..  6  Pearlman,  K.  (1981).  Task  differences  as 

moderators  of  aptitude  test  validity  in  selection:  A  red  herring.  Journa l 
of  Applied  Psychology.  66(2),  166-185. 

Schorl,  T.  R.  (1973).  A  comparison  model  ot  visual,  auditory,  and  cutaneous 
tracking  displays  when  divided  attention  is  required  to  a  cross  adaptive 
loading  task.  Ergonomics.  16,  153  158. 

Schorl,  T.  R.,  6  Jones,  B.  W.  (1975).  Smoking  and  work  load.  Journal  of 
Motor  Behavior.  7,  113  120. 

Schouten,  J.  P.,  Kalsbeek,  J.  W.,  H.,  6  Leopold.  F.  F.  (1962).  on  the 
evaluation  of  perceptual  and  mental  load.  Ergonomics,  5,  251-260. 

Schroeder,  S.  R . ,  6  Holland,  J.  G.  (1968).  Operant  control  of  eye  movements 
during  human  vigilance.  Sc  1  once ,  161,  292-293. 

Schultz,  W.  C.,  Newell,  F.  U.,  6  Vhlrbeck,  R.  F.  (1970).  A  study  of 

relationships  between  aircraft  system  performance  and  pilot  ratings. 
Proceedings  of  the  6th  Annual  NASA -  Un 1 ve r s 1 ty  Conf erence  on  Manua 1  Cont  ro 1 
(pp.  339  340).  Wright  Patterson  AFB ,  OH. 

SebeJ,  F.,  6  Biro,  v.  Effect  of  psychic  load  on  the  course  of  respiration. 
Stud la  Psycholoq lea ,  20 ,  6771. 

Seifert,  R.,  Daniels,  A.  F.,  6  Schmidt,  K.  (1972).  A  method  of  man  dtsplay/ 
control  system  evaluation.  Proceedings  of  the  AOARb  Conference  on 
Guidance  and  Control  Displays  ( AGANU  cp  96)  (pp.  8.1  8.8). 
Neuilly-sur-Seine,  France:  Advisory  Group  for  Aerospace  Research  and 
Development . 

Seklguchl,  C.,  Handa,  Y . ,  Gotoh.  H.,  Kurthara,  ¥.,  Nagasawa,  A.,  &  Kuroda.  I. 
Evaluation  method  of  mental  workload  under  flight  condit ions- relat ionshlp 
to  heart  rate  variability.  Aviation,  Space,  and  Environmental  Medicine. 
49,  920-925. 


HO 


Sea- Jacobsen,  c.  V.  (1976).  BOG  Monitoring  of  heart  failure  and  pilot 

Load/overload  by  the  Vesla  seat  pad.  Aviation,  space,  and  Bnvtronaental 
Medicine.  £7.  441-444. 

Senders,  J.  (1979).  Axiomatic  nodels  of  workload,  in  N.  Moray  (Ed.)  Mental 
workload:  its  theory  and  measurement  (pp.  263-267).  Mew  York:  Plenum 
Press . 

Senders.  J.  V.  (1970).  The  estimation  of  operator  workload  in  complex  systems. 
In  K.  B.  DeGreene  (Ed.),  Systems  psychology  (pp.  207-216).  New  York: 

McGraw  Mill. 

Senders,  J.  V. ,  &  Gottsdanker,  R.  M.  (1960).  On  the  estimation  of  mental 
workload  (Pinal  Rep.  for  Contract  Mo.  APOSR-79-0133) .  Santa  Barbara: 
University  of  California,  Department  of  Psychology.  (DTic  No.  AD  A094783). 

Senders,  J.  W. ,  Kristofferson,  A.  B..  Levlson,  V.  II.,  Dietrich,  C.  V.,  &  Ward. 
J.  L.  (1967).  The  attentional  demand  of  automobile  driving.  Highway 
Research  Record.  No.  195,  15-33. 

Senders,  J.  W. ,  6  Posner.  M.  J.  M.  (1976).  A  queueing  model  of  monitoring  and 
supervisory  behavior.  In  T.  B.  Sheridan  &  G.  Johannsen  (Eds.),  Monitoring 
behavior  and  supervisory  control  (pp.  245-259).  New  York:  Plenum  Press. 

Shaw,  M.  L.  (1982,  August).  Attention  and  decision  factors  in  hi modal 

signal  processing  (AFOSH  TR-82  0712) .  Bolling  Air  Force  Base,  DC:  U.S. 

Air  Force  office  of  scientific  Research.  (NTIS  No.  AD  A1 19181) 

Sheridan,  T.  8.,  6  Stassen,  H.  G.  (1979).  in  N.  Moray  (Ed.)  Mental 

workload:  Its  theory  and  measurement  (pp.  219  233).  Mew  York:  Plenum 
Press.  t 

Shlngledecker ,  C.  A.  (1984).  A  task  battery  for  applied  human  performance 
assessment  research  (AFAMKL  TR  84  071).  Wright  Patterson  AFB,  OH:  Air 
Force  Aerospace  Medical  Research  laboratory. 

Shlngledecker,  C.  A.  (1980).  Enhancing  operator  acceptance  and  nonlnter 

ference  in  secondary  task  measures  of  workload.  Proceedings  of  the  Human 
Factors  Society  24th  Annual  Meeting,  pp.  674  67/. 

Shlngledecker.  C.  A.  (1983,  April).  Behavioral  and  subjective  workload  metrics 
for  operational  environments.  Neulllysur  Seine,  France:  AGARD  Conference 
Proceedings  Mo.  338  (pp.  6.1-6.10).  Advisory  Group  for  Aerospace  Research 
6  Development.  (NTIS  No.  AD  A139324) 

Shlngledecker,  C.  A.  (1986).  The  criterion  task  set:  Validation  and  appli 

cation.  Proceedings  of  the  Human  Factors  Society  30th  Annual  Meeting,  pp. 
1,  57  (abstract  only). 

3hlngledecker,  C.  A.,  Acton,  ¥.  H.,  6  Crabtree,  M.  S.  (1983),  SAE  technical 
development  and  application  of  a  criterion  task  set  for  workload  metric 
evaluation  (Rap.  No.  831419).  bong  Beach,  CA:  Society  of  Automotive 
Engineers,  Inc. 


Ill 


Shingledecker,  C.  A.,  Crabtree.  M.  S.,  &  Action,  W.  H.  (1982).  Standardized 
tests  Cor  the  evaluation  and  c lass 1 Cleat  ion  oC  workload  metrics. 
Proceedings  oC  the  Human  Factors  Society  26th  Annual  Meeting,  pp.  648-651. 

ShlCCrin,  8.  M.,  &  Gardner,  G.  T.  (1972).  Visual  processing  capacity  and 
attention  control.  Journal  oC  Experimental  Psychology,  93,  72-82. 

Shively,  R.  J.,  Battlste.  V.,  Matsumoto,  j.  H.,  Pepltone,  D.  D..  Bortolussl, 

M.  8.,  &  Hart,  S.  G.  (1987).  InClight  evaluation  oC  pilot  workload 
measures  Cor  rotorcraCt.  Proceedings  oC  the  Pourth  Symposium  on  Aviation 
Psychology  (pp.  637-643). 

Shulman,  H.  G.,  &  Briggs,  G.  E.  (1971).  studies  oC  performance  in  complex 
aircrew  tasks  (RP  Project  2718,  Pinal  Report).  Columbus,  OH:  The  Ohio 
State  University,  Research  Foundation. 

Shulman,  H.  G.,  &  Greenberg,  S.  N .  (1971).  Perceptual  deficit  due  to 
division  oC  attention  between  memory  and  perception.  Journal  of 
Experimental  Psycho logy ,  88 .  171-176. 

Siegel,  J.  M. ,  6  McGlnty,  D.  J.  (1976).  Pontine  reticular  formation  neurons: 
Relationship  of  discharge  to  motor  activity.  Science,  196 ,  678  679. 

Siegel,  A.  1.,  6  Williams,  A.  K.,  Jr.  (1974).  Identification  and  measurement 
of  intellective  load  carrying  thresholds  ( AFOSR  TR  75  0593).  Wayne.  PA: 
Applied  Psychological  Services.  (AO  A009  159) 

Siegel,  A.  I.,  Lanterman.  R.  S.,  Platzer,  H.  1,. ,  6  Wolf,  J.  J.  (1976). 
Techniques  for  evaluating  operator  loading  In  man-machine  systems: 
Development  of  a  method  for  real  time  assessment  of  opeator  overloading . 
Wayne,  PA:  Applied  Psychological  Services.  (AD  479  045) 

Siegel,  A.  1.,  Wolf.  J.  J.,  Plschl,  M.  A.,  Mlehle,  W. ,  &  Chubb,  G.  P.  (1971). 
Modification  of  the  Selgel-Wolf  operator  simulation  model .for  on  line 
experimental  Ion.  Wright  Patterson  APB,  OH:  ASAP  Aerospace  Research 
Laboratory . 

Sllversteln,  L.  0.,  Comer,  P.  K. ,  Crabtree,  M.  5.,  6  Acton,  W.  H.  (1984). 

A  comparison  of  analytic  and  subjective  techniques  for  estimating 
communications  related  workload  dur  Ing  commercial  t_ranspor  t  f  light 
operations  (NASA  CR  2341).  Washington,  DC:  National  Aeronautics  arid  space 
Admlnlst rat  ton. 

Simmons,  8.  8.  (1979).  Methodological  conslderat lotis  of  visual  workloads  of 
helicopter  pilots.  Human  Factors,  2J,,  353  367. 

Simmons,  8.  8.,  &  Kimball,  K.  A.  (1977).  Methodological  considerations  of 
visual  workloads  of  helicopter  pilots.  Proceedings  of  the  AGARD 
conference  on  Methods  to  Assess  Workload  (A2  l)  (AGARD-  CPP  216). 

Heull ly-sur-Selne,  France:  Advisory  Group  for  Aerospace  Research  and 
Development . 


11? 


Simmons,  R.  R,,  &  Kimball,  K.  A.  (1979).  Operator  visual  workload  shifts  as  a 
function  of  vehicle  stability.  Proceedings  of  the  Human  Factors  Society 
23rd  Annual  Meeting  (pp.  352-356).  Santa  Monica:  Human  Factors  society. 

Simmons,  R.  R.,  &  Kimball,  K.  A.,  6  Diaz,  J.  J.  (1976).  Measurement  of 

aviator  visual  performance  and  workload  during  helicopter  operations  (Rep. 
Mo.  77-4).  Ft.  Rucker,  AL:  US  Army  Aeromedlcal  Research  Laboratory. 

Simmons,  R.  R.,  Lees,  M.  A.,  &  Kimball,  K.  A.  (1976,  January).  Visual 

performance/workload  of  helicopter  pilots  during  instrument  flight  (USAARL 
Rep.  No.  78-6).  Washington,  DC:  U.S.  Army  Medical  R6D  Command. 

Simmons,  K.  R.,  Lees.  M.  A.,  6  Kimball,  K.  A.  (1976).  Aviator  visual 

performance:  a  comparative  study  of  a  helicopter  simulator  and  the  UH  1 
helicopter.  In  AGARD  Operational  Helicopter  Aviation  Medicine  (pp. 

52.1  52.13)  ( AGARO-CP-255) .  Neull ly-sur-Selne,  France:  Advisory  Group  for 
Aerospace  Research  and  Development. 

Simmons,  K.  R.,  Sanders,  M. ,  6  Kimball,  K.  A.  (1979).  visual  performance:  a 
method  to  assess  workload  In  the  flight  environment.  In  B.  o.  Hartman  & 

R.  E.  McKenzie  (Eds.)  Survey  of  methods  to  assess  ’workload  (pp.  73-81) 
(AGARD  AG  246) .  Neul 1 ly-sur-Selne ,  France:  Advisory  Group  for  Aerospace 
Research  and  Development. 

Simms.  T.  M.  (1967).  Pupillary  response  of  male  and  female  subjects  to 

pupillary  difference  in  male  and  female  picture  stimuli.  Perception  6 
Psychophysics .  2(11).  553  555 . 

Simonov,  P.  V.,  6  Frolov,  M.  V.  (1977).  Analysis  of  the  human  voice  as  a 

method  of  controlling  emotional  state:  Achievements  and  goals.  Aviation, 
Spacej.  and  Environmental  Medicine,  48,  23  25. 

Simonov,  P.  V.,  6  Frolov,  M.  V.  (1985,  August).  Blink  reflex  as  a  parameter  of 
human  operator's  functional  state.  Aviation,  Space,  and  Environmental 
Medicine,  56,  783  785. 

Simonov,  P.  V.,  Frolov,  M.  V.,  &  Sviridov,  E.  P.  (1975).  Chat acter 1st les  of 
the  elect t oca rd log ram  under  physical  and  emotional  stress  in  man. 

Aviation,  space,  and  Environmental  Medicine,  46,  141  141. 

Simpson,  H.  M. ,  6  Hale,  S.  M.  (1969).  Pupillary  changes  during  a  decision 
making  task.  Perceptual  and  Motor  Skills,  29,  495  49B. 

Simpson,  H.  M. ,  6  Palvlo,  A.  (1966).  Changes  In  pupil  size  during  an  imagery 
task  without  motor  response  Involvement.  Psychonomlc  Science.  5(10), 

405  406. 

Skipper,  J.  H.,  6  Wlerwllle,  W.  W.  (1986).  Drowsy  driver  detection  using 
discriminant  analysis.  Human  Factors.  28(5),  527  540. 

Smlt,  J.  (1976).  Pilot  workload  analysis  based  upon  In  flight  physiological 
measurements  and  task  analysis  methods.  In  T.  B.  Sheridan  and  G. 

Johannsen  (Eds.)  Monitoring  behavior  and  supervisory  control  (pp. 

119  124).  New  York:  Plenum. 


m 


Salt,  J.,  &  Newer  Inkle,  P.  H.  (1978).  An  analysis  of  helicopter  pilot  control 
behavior  and  workload  during  Instrument  flying  tasks.  In  AO  ARP 
operational  helicopter  aviation  medicine  (30.1-30.11)  (AGARD-CP-255) . 
Neullly-sur-Selne,  Prance:  Advisory  Group  for  Aerospace  Research  and 
Development . 

Smith,  H.  P.  R.  (1979).  A  simulator  study  of  the  Interaction  of  pilot 

workload  with  errors,  vigilance,  and  decisions  (NASA-TM-78482) .  Moffett 
Field,  CA:  National  Aeronautics  and  Space  Administration  (Ames  Research 
Center) . 

Soede,  M.  (1977).  Reduced  mental  capacity  and  behavior  of  a  rider  of  a 
bicycle  simulator  under  alcohol  stress  or  under  dual  task  load. 

Proceedings  of  the  13th  Annual  NASA- University  Conference  on  Manual 
Control  (pp.  143  151). 

Soede,  M.  (1979).  on  mental  workload  and  reduced  mental  capacity;  some 
considerations  concerning  laboratory  and  field  Investigations.  In  N. 

Moray  (Ed.)  Mental  workload:  Its  theory  and  measurement  (pp.  445  467). 

New  York:  Plenum  Press. 

Soutendam,  J.  (1977).  Instruments  and  methjodology  for  the  assessment  of 

physiological  cost  of  performance  in  stressful  continuous  operations  (he 
air  traffic  services  tower  environment.  Proceedings  of  the AGARD 
Conference  on  Methods  to  Assess  Work  toad  (A7.1  A7.12)  ( AGAKU  CPP  216). 
Neullly  sur  Seine,  Prance:  Advisory  Group  for  Aerospace  Research  and 
Development . 

Spady,  A.  A.  Jr.  (1978).  Airline  pl_lot_  scan  patterns  during  slmu  la  ted  n.s 
approaches  (NASA  TP  1250).  Hampton,  VA:  National  Aeronautics  and  Space 
Administration,  '.angley  Research  Center . 

Speraridio,  J.  C.  (19/1).  Variation  of  operator’s  strategies  and  regulating 
effects  on  workload.  Ej9°no,t,)cs-  .14,  571  577. 

Sperandlo,  J.  C.  (1978).  The  regulation  of  working  methods  as  a  function  of 
work  load  among  air  traffic  con! rol ler s .  Ergonomics ,  21,  195  202. 

Splcuzza,  K.  J.,  Plrtkus,  A.  R.,  &  O'Donnell .  R.  0.  (1974).  Development  of 
performance  assessment  methodology  for  the  digital  avionics  Information 
system)  Pinal  Report:  l  December  1973  30  June  1974).  Dayton.  Oil: 

Systems  Reseat  oh  i.aborator  les. 

Spyker,  D.  A..  Stackhouse,  S.  P..  Khalafalla,  A.  S..  6  Mcl.ane,  K.  C.  (1971). 
Development  of  techniques  for  measuring  pilot  workload  (NASA  CR  1888). 
Washington,  D.C.:  National  Aeronautics  and  Space  Administration. 

Stackhouse.  S.  (1973).  Workload  evaluation  of  LI.NO  Displays  (7201  3408). 
Minneapolis,  MN:  Honeywell. 

Stackhouse,  S.  (1976).  The  measurement  of  pilot  wot  k 1 oad  in  manual  cont  rol 
system  (FG398  KKl).  Minneapolis,  MN:  Honeywell. 


114 


Stager,  P.,  &  Muter,  P.  (1971).  Instructions  and  Information  processing  in  a 
complex  task.  Journal  of  Experimental  Psychology,  87 ,  291-294. 

Stager,  P.,  &  Zufelt,  K.  (1972).  Dual-task  method  in  determining  load 
differences.  Journal  of  Experimental  Psychology,  94,  113-115. 

Stamford.  8.  A.  (1976).  Validity  and  reliability  of  subjective  ratings  of 
perceived  exertion  during  work.  Ergonomics,  ^9,  53-60. 

Staveland,  L.,  Hart,  S.  G.,  &  Yeh,  Y.  Y.  (1985).  Memory  and  subjective 

workload  assessment.  Proceedings  of  the  21st  Annual  Conference  on  Manual 
Control  (NASA  CP-2428,  pp.  7.1-7.13).  Washington,  DC:  National 
Aeronautics  and  Space  Administration. 

Stein,  E.  S.,  Fabry,  J.,  &  Rosenberg,  B.  (1982).  The  elusive  goal  of 

measuring  pilot  workload  in  qeneral  aviation.  In  M.  L.  Frazier  6  R.  B. 
Crombie  (Eds.),  Proceedings  of  the  Workshop  on  Flight  Testing  to  Identify 
Pilot  Workload  and  Pilot  Dynamics  (APFTC  TR-82  5,  pp.  275  280).  Edwards 
Air  Force  Base.  CA:  Air  Force  Flight  Test  Center.  (DTIC  No.  AD  A129333) 

Steininger,  K.  (1977).  Subjective  ratings  of  flying  qualities  and  pilot 
workload  in  the  operation  of  a  short  haul  jet  transport  aircraft. 
Proceedings  of  AGARP  Conference  on  Studies  on  .Pi  lot  Workload  ( B1 1 . 1 ) 

( AGAKD  CPP-217).  Neuillysur- Seine,  France:  Advisory  Group  for  Aerospace 
Research  and  Development. 

Stern,  J.  A.,  6  Bynum.  J.  A.  (1970,  March).  Analysis  of  visual  search  activity 
in  skilled  and  novice  helicopter  pilots.  Aerospace  Medicine,  41(3), 
300305. 

Stern,  J.  A.,  6  Skelly,  J.  J.  (1984).  The  eye  blink  and  workload  consldera 
tlons.  Proceedings  of  the  Human  Factors  Society  23th  Annuo*  Meeting.  2, 

942  944. 

Stern,  J.  A.,  Walrath,  I..  C.,  6  Goldstein,  K.  (  1984  ).  The*  endogenous 
eyebllnk.  Psychophysiology.  21.  22  33. 

Stone,  1..  W. ,  &  Duncan,  C.  E.  (1964).  Effects  of  extended  use  of  AN/PVS  5 
night  vision  goggles  on  helicopter  pilots’  performance  (tisAARl.  TK  84  3). 
Fort  Rucker,  Al.:  U.S.  Army  Aerocned  ir ,» 1  Keseai  <•  h  l.abot  itoiy.  (DTIC  No.  AD 
A 1 381 2.6  ) 

Stone.  I..  W.,  Sanders.  M.  G.,  Gltck.  D.  D.  ,  Wiley.  K..  6  Kimball.  K.  A.  (197')). 
A  human  performance/work  load  evaluation  of  the  AN/PVS  5  bifocal  night 
vision  goggles  (USAAKL  Report  No.  79  11).  Ft.  Rucker,  Al.:  US  Army 
Aeromedlcal  Research  Laboratory. 

Storm,  W.F.,  Hartman,  B.O.,  Intano,  G.P.  6  Peters,  G.L.  (August,  1976). 
Endocrine  met abol Ic  effects  In  short  duration  high  workload  missions: 
Feasibility  study  (SAM  TK  76  30).  Brooks  AFB,  Texas:  USAF  School  of 
Aerospace  Medicine,  . 


llr> 


Strasser,  H.  (1979).  Measurement  of  mental  workload.  In  N.  Moray  (Ed.). 
Mental  workload:  Its  theory  and  measurement.  New  York:  Plenum  Press, 
345-348. 

Strasser,  H.,  Brllllng,  G.,  Klinger,  K.P.,  &  Mueller-Llramroth,  W.  (1973). 
Physiological  and  operational  state  of  a  group  of  aeroplane  pilots  under 
the  conditions  of  stressing  tracking  tasks.  Aerospace  Medicine.  44. 
1040-1047. 

Street,  R.L.,  Singh,  H.  S,  Hale.  P.N.,  Jr.  (1970).  The  evaluation  of  mental 
stress  through  the  analysis  of  parotid  fluid.  Human  Factors,  12,  453-455. 

Stress  in  Air  Traffic  Control  Research  Association,  (June  1971).  Proceedings 
of  the  International  Symposium  on  Objective  Assesment  of  Work  Load  in  Air 
Traffic  Control  Tasks,  Technlsche  Universitaet  Darmstadt,  West  Germany. 
Ergonomics,  14 . 

Strieb,  M.l.  (August  1975).  The  human  operator  simulator.  Volume  I: 

Introduction  and  overview.  Willow  Grove,  Pennsylvania:  Analytics. 

Strieb,  M.l.  6  Harris,  R .  (  1978,  October).  Sensitivity  analyses  for  cost 

effectiveness  of  P  3C  SS-3  operator  station: _ the  human  ope  t at  or 

simulator ,  vol .  X  part  2  (Tech.  Report  1330).  Willow  Grove, 

Pennsylvania:  Analytics. 

Strieb,  M.l.,  Preston,  J.K..  Ill,  Harris,  R . ,  6  Fisher,  C.  (1987,  March27). 
Weapon  system  economic  analysis- the  human  operator  simulator,  volume _V III 
(Tech.  Hepor t  1  289).  Wl 1  low  Grove ,  Pennsy Ivan  la :  Analytics. 

Strother,  U.D.  (19/4).  Visual  activities  of  the  helicopter  pilot  during 
low- alt itude,  vfr  flight.  Aircrew  performance  in  army  aviation. 
Proceedings  of  a  conference,  27  29  Novembe r ,  1973 .  Fort  Rucker,  Alabama: 
U.S.  Army  Aviation  Center,  188  192. 

Sulzer,  K.L.,  Co*.  W.J.,  (,  Mohler,  S.K.  (1981).  Flight  crewmember 

workload  evaluation  (Rep.  Nos.  OOT/FAA/RD  82/21  6  UOT/FAA/ASF  82/1). 
Washington,  (x::  u.:«.  Department  of  Transport  at  Ion,  Federal  Aviation 
Administration.  (OTIC  No.  AD  A1 14167) 

Sun,  P.B..  Keane,  W.P.  6  Stackhouse,  S.P.  (1976,  Apr l ’ ) .  The  measurement  of 
pilot  workload  in  manual  control  systems.  Proceedings  of  Aviation 
Electronics  Symposium.  Fort  Monmouth,  New  Jersey. 

Sutton,  S.,  Braren,  M.  ,  7,ubin,  J.,  &  John,  E.  R.  (1965).  Evoked  potential 
correlates  of  stimulus  uncertainty.  Science,  15J ,  1187  1188. 

Teece.  J.  J.,  6  Scheff,  N.  M.  (1969).  Attention  reduction  and  suppressed 
direct  current  potentials  In  the  human  brain.  Science.  164.  331  333. 

Telger,  C.  (1978).  Regulation  of  activity:  An  analytical  toot  for  studying 
work  load  in  perceptual  motor  tasks.  Ergonomics.  21.  203  213. 


Teper,  G.L.,  Hon,  R.H.,  &  Smyth,  R.K.  (1977,  September).  Preliminary 

candidate  advanced  avionics  system  (PCAAS)  -  reduction  In  single  pilot 
workload  during  Instrument  flight  rules  flight  (Tech  Report  1084-1. 
NASA-CR- 152026 ) .  Hawthorne,  California:  Systems  Technology  Inc. 

TerBraak,  P.  (1974,  October).  High  workload  tasks  of  aircrew  In  the  tactical 
strike,  attack  and  reconnaissance  roles.  In  AGARD  simulation  and  study  of 
high  workload  operations  (agakd-CP-146),  A17-1  -  17-3. 

Thackray,  R.I.,  Jones,  K.N.,  and  Touchstone,  R.M.  (1973,  March).  The 

color-word  interference  test  and  its  relation  to  performance  impairment 
under  ausitory  distraction  ( PAA- AM-72- 14) .  Oklahoma  City,  Oklahoma: 

Civil  Aeromedlcal  Institute. 

Thlessen,  M.  S.,  Lay,  J.  K.,  &  Stern,  J.  A.  (1988).  Neuropsychological 
workload  test  battery  validation  study  (Pinal  Report  Contract  P 
33615  82-C-0517).  Wright  Patterson  APB,  OH:  Harry  G.  Armstrong  Medical 
Research  Laboratory. 

Thorshelm,  H.  I.  (1967).  EEC  and  vigilance  behavior.  Psychonomlc  Science, 
8(11).  499  500. 

Tole,  J.  R . ,  Stephens,  A.  T. ,  Harris.  K.  L. ,  6  P.phrath,  A.  R.  (1982). 

Quantification  of  pilot  workload  via  Instrument  scan.  In  M.  L.  Frazier  & 
K.  B.  Cromble  (Eds.),  Proceedings  of  the  workshop  on  Flight  Testing  to 
Identify  Pilot  Workload  and  Pilot  Dynamics  ( AFFTC  TR  82  5,  pp.  234  250). 
Edwards  Air  Force  Base,  CA:  Air  Force  Flight  Test  Center.  (DT1C  No.  AD 
A129333) 

Travis,  R.  C.,  6  Kennedy,  J.  I..  (1946,  June).  Review  of  literature  and  some 
preliminary  results  In  the  development  of  an  alertness  Indicator  (Rep.  No. 
1).  Port  Washington,  L.I.,  NY:  Special  Devices  Center,  Office  of  Naval 
Research.  (NTIS  No.  AD6 39040) 

Trlggs,  T.J.  (1969,  September).  Aspects  of  mental  workload.  Proceedings  of 
the  T_R?E_~GMMS_  prs  International  JJympo.s l um  on  Man  Mach  1  ne  Gy s terns , 
Cambridge,  England. 

Tioy,  M. ,  Chen,  S.  C. ,  &  Stern,  J.  A.  (1972).  Computer  analysis  of  eye 
movement  patterns  during  visual  search.  Aerospace  Medicine,  43(4), 

390  394. 

Trumbo,  U.  6  Noble,  M.  (  1972).  Kesi>onse  uncet  tat  Inty  In  dual  task 

per fot mance .  Organlzat lonal  Behavior  and  Hitman  Performance,  7,  203  215. 

Trumbo,  D.,  Noble,  M.  6  Swlnk,  J.  (1976).  Secondary  task  interference  In  the 
performance  of  tracking  tasks.  Journal  of  Experimental  Psychology .  73, 

232  240. 

Tsang,  P.,  &  Wlckens,  C.  D.  (1983).  The  effects  of  task  difficulty 

changes, and  strategic  resources  allocation  training  on  time  sharing 
performance  (Rep.  No.  KPl.  83  3/ONK  83  3,  pp.  I  45).  Champaign.  IL:  Office 
of  Naval  Research  Engineering  Psychology  Program. 


117 


Tsang,  P.  s.,  6  Wlckens,  C.  0.  (1984).  The  effects  of  task  structures  on 
tine-sharing  efficiency  and  resource  allocation  optimality.  Twentieth 
Annual  Conference  on  Manual  Control  Volume  I  (Rep.  Ho.  NASA  CP-2341,  pp. 
1-45).  Moffett  Field,  CA:  National  Aeronautics  and  Space  Adn in 1st rat ion. 

Ulrich,  T.  B.,  &  Gorman,  C.  D.  (1983).  Job  difficulty  data  as  an  indicator 
of  job  conplexity.  Proceedings  of  the  24th  Annual  Conference  on  the 
Military  Testing  Association  (AFHRL-TP-83-16) .  pp.  665-670.  (DTIC  Ho.  AO 
A126554) 

Ursln,  H.  6  Ursin,  R.  (1979).  Physiological  indicators  of  mental  load.  In  N. 
Moray  (Ed.)  Mental  workload:  its  theory  and  measurement.  New  York: 
Plenum  Press,  349-365. 

van  Gigch,  J.P.  (1970).  A  model  for  measuring  the  Information  processing 
rates  and  mental  load  of  complex  activities.  Canadian  Operational 
Research  Society  Journal.  8,  116-128. 

van  Gigch,  J.P.  (1970).  Applications  of  a  model  used  in  calculation  the 

mental  load  of  workers  in  industry.  Canadian  Operational  Research  Society 
Journal ,  8.  176-184 

Verplank.  VI. L.  (1976,  May).  Is  there  an  optimum  work  load  in  manual  control? 
Proceedings  of_  the  12th  Annual  NASA-Unlvorsity  Conf erence  on  Manual 
Control  (NASA  TM  X- 73,  170)).  University  of  Illinois" 

Verplank,  W.  L.  (197/).  The  facilitation  effects  of  uncertainty  in  lonq  term 
manual  control.  Proceedings  of  the  13th  Annual  Conference  on  Manual 
Control,  Massachusetts  Institute  of  Technology.  101  117. 

Vicente,  K.  J.,  Thornton,  0.  C.,  6  Moray,  N .  (1987).  Spectral  analysis  of 

sinus  arrhy thria : ' A  measure  of  mental  effort.  Human  Factors,  29,  171  182. 

Vidullch,  M.  A.  (1986).  Kesi*>nse  modalities  and  time  sharing  performance. 

Proceedings  of  the  Human  Pact ors  society  30th  Annual  Meeting,  1,  337  341 . 

Vidullch,  M.  A.  (1988).  The  cognitive  psychology  o<l  subjective  mental 

workload.  In  P.  A.  Hancock  6  N.  Meshkat l  (Kds.),  Human  mental  workload 
(pp.  219  229).  Amsterdam:  Elsevier. 

Vidullch,  M.  A.,  6  Bortolussl,  M.  K.  (1988).  A  dissociation  of  objective  and 
subjective  workload  measures  in  assessing  the  impact  of  speech  controls  in 
advanced  helicopters.  Proceedings  of  the  Human  Factors  Society  3 2nd 
Annual  Meeting  (pp.  1471  1475).  Santa  Monica,  CA:  Human  Eactors  Society. 

Vidullch,  M.  A.,  6  Tsang,  P.  S.  (1985).  Assessing  subjective  workload 
assessment:  A  comparison  of  SWAT  and  the  NASA  bipolar  methods. 

Proceedings  of  the  Human  Factors  Society  29th  Annual  Meeting.  I,  71-75. 

Vtduilch,  H.  D.,  &  Tsang,  P.  S.  (1986).  Techniques  of  subjective  workload 
assessment:  A  comparison  of  SWAT  and  the  NASA  Bipolar  methods. 

Ergonomics.  29(11).  11385  1398. 


Vldullch,  M.  A.,  &  Tsang,  P.  s.  (1987).  Absolute  magnitude  estimation  and 
relative  judgement  approaches  to  subjective  workload  assessment. 

Proceedings  of  the  Human  Pactors  Society  31st  Annual  Meeting  (pp. 
1057-1061).  Santa  Monica,  CA:  Human  Pactors  Society. 

Vldullch,  N.  D.,  &  Vlckens,  C.  D.  (1982).  The  influence  of  S--C-R  compatibility 
and  resource  competition  on  performance  of  threat  evaluation  and  fault 
diagnosis.  Proceedings  of  the  Human  Pactors  Society  26th  Annual  Meeting, 
pp.  223-226. 

vldullch,  M.  D.,  &  Vlckens,  C.  D.  (1983,  October).  Processing  phenomena  and 
the  dissociation  between  subjective  and  objective  workload  measures 
(BPL-83-2/ONR-33-2) .  Arlington,  VA:  Office  of  Naval  Research,  Engineering 
Psychology  Program.  (NTIS  No.  AD  A134050) 

Vldullch,  M.  A.,  &  Vlckens,  C.  D.  (1984).  Subjective  workload  assessment  and 
voluntary  control  of  effort  In  a  tracking  task.  Twentieth  Annual 
Conference  on  Manual  Control  Volume  I  (Rep.  No.  NASA  CP- 2341,  pp.  57-71). 
Moffett,  CA:  National  Aeronautics  and  Space  Administration. 

Vldullch,  M.  A.,  &  Vlckens,  C.  D.  (1985).  Causes  of  dlssaclation  between 
subjective  workload  measures  and  performance:  Caveats  for  the  use  of 
subjective  assessments.  Proceedings  of  the  Third  Symposium  on  Aviation 
Psychology,  pp.  223  230. 

Waller,  M.C.  (  1976.  March).  An  investigation  of  correlations  between  pilot 
scanning  behavior  and  workload  using  stepwise  regression  analysis  (NASA  TM 
X-3344).  Hampton.  Virginia:  NASA  Langley  Research  Center. 

Waller,  M.C.,  Harris  R.L.,  lir . .  6  Salmlrs,  S.  (1979).  A  study  of  parameters 
affecting  a  display  for  aircraft  Instrument  landing.  Proceedings  of  the 
2 3rd  Annual  Meeting  of  the  Human  Pactors  Society,  Boston,  Mas-  ■’  njsetts. 
October  29  November  l,  1979,  345  346. 

Warren,  C.  A.,  Stern,  J.  A.,  Eddy,  U.  R.,  Horst,  R.  L.,  Kramer  ,  A.  F., 

Parasuraman,  R.,  Sangulst,  T.  F. ,  6  Wilson,  C.  F.  (1985).  The  role  of 
event  related  potentials  In  human  machine  app) icat ions .  Proceedings  of 
the  Human  Factors  Society  29th  Annual  Meeting,  2,  981  985. 

Watson,  B.L.  (  1972,  June).  The  effect  of  secondary  tasks  on  pilot 

describing  functions  In  a  compensatory  tracking  task  (UTIAS  Tech.  Note  No. 
178).  Toronto,  Canada:  University  of  Toronto,  Institute  for  Aerospace 
Studies 

Waugh,  J.U.  (1975,  September).  Pilot  performance  In  helicopter  simulator 

(AD  A017  441).  Aberdeen  Proving  Ground,  Maryland:  U.S.  Army  Engineering 
Laboratory,  Technical  Memorandum  23  75. 

Wilson,  0.,  6  O’Donnell,  R.  (1988).  Measurement  of  operator  workload  with  the 
neuropsychological  test  battery.  In  P.  S.  Hancock  6  N  Mexhkati  (Eds.), 
Human  mental  workload.  Amsterdam:  Elsevier. 


Wilson,  0.  P. ,  Ward,  S.L.,  &  Hann,  R.  L.  (1965).  The  use  of  brain  evoked 
response  in  a  critical  event  detection  task.  Proceedings  of  the  Human 
Factors  Society  29th  Annual  Meeting  (pp.  962-965).  Santa  Monica,  CA: 

Human  Factors  society. 

Way,  T.C.  (1976,  September).  Verification  of  workload-a  job  for 

simulation-pilot  performance.  In  Flight  Technologies  Conference. 
Arlington:  Texas,  American  Institute  of  Aeronautics  and  Astronautics,  New 
York,  99-104. 

Way,  T.  C.  (1981).  Pilot  workload  -  a  practitioner's  problem.  Proceedings 
of  the  Human  Factors  Society  25th  Annual  Meeting,  p.  53  (abstract  only). 

Weir,  D.H.  6  Klein,  R.H.  (1970,  April).  Measurement  and  analysis  of  pilot 
scanning  behavior  during  simulated  Instrument  approaches.  Proceedings  of 
the  6th  Annual  NASA-  University  Conference  on  Manual  Control. 

Wright-Pat terson  AFB,  83-108. 

Welford,  A.T.  (1973).  Stress  and  performance  behavioral  and  ergonomics 
aspects.  Ergonomics,  16,  567-580. 

Welford,  A.T.  (1978).  Mental  work  load  as  a  function  of  demand,  capacity, 
strategy  and  skill.  Ergonomics.  21,  151-167. 

Weltman,  G.,  Smith,  J.  K. ,  &  Kgstrom,  G.  M.  (1971).  Perceptual  narrowing 

during  simulated  pressure  chamber  exposure.  Human  Factors,  1_3 ( 2 ) ,  99-107. 

Wewerlnke,  P.H.  (1976,  May).  Human  control  and  monitoring  models  and 

experiments.  Proceedings  of  the  12th  Annual  NASA-Unlverslty  Conference  on 
Manual  Control  (NASA  TMX  73,  170).  University  of  Illinois,  14  38. 

Wewerlnke,  P.H.  (1977,  June),  performance  and  workload  analysis  of  in  flight 
helicopter  tasks.  Proceedings  of  the  13th  Annual  NASA  University 
Conference  on  Manual  Control,  Massachusetts  Institute  of  Technology, 

106,1 17 . 

Wewerlnke,  P.H.  6  Smlt,  J.  (1974,  April).  A  simulator  study  to  Investigate 
human  operator  -workload.  Proceedings  of  the  AGARD  Conference  on 
Simulation  and  Study  of  High  Workload  Operations  (AOAKU  CP  146),  A2  1 
A2  6. 


Whitaker,  1..A.  (1979).  Dual  task  interference  as  a  function  of  cognitive  load 
proceeding.  Acta  Psychologlca,  43,  71  84. 

Whitaker,  L.  A.,  Shoptaugh,  C.  F.,  6  Haywood,  K,  M.  (1986).  Effect  of  age  on 
horizontal  eye  movement  latency.  American  Journal  of  Optometry  6 
Physiological  Optics,  63(2).  152  155. 

White,  R.T.  (1971,  September).  Task  analysis  methods:  Review  and  development 
of  techniques  for  analyzing  mental  workload  in  multiple  task  situations 
(MUC  J  5291).  St.  l/xii»,  Missouri:  McDonnell  Douglas  Corporation.. 


White,  R.T.  (1975,  December) .  Mental  workload  assessment,  I.  Laboratory 

Investigations  of  decision-making  and  short-term  memory  in  a  multiple-task 
situation  (MDC  J6662/01).  St.  Louis,  Missouri:  McDonnell  Douglas.. 

White,  R.T.  &  Cause ,  j.o.  (1975,  December).  Mental  assessment.  III. 

Laboratory  evaluation  of  one  subjective  and  two  physiological  measures  of 
mental  workload  (Report  MDC  J7024/0U.  St.  Louis,  Missouri:  McDonnell 
Douglas  Corporation. 

White,  S.  A.,  MacKinnon,  D.  P.,  &  Lyman,  j.  (1986).  Modified  Petri  net 
model  sensitivity  to  workload  manipulations.  Proceedings  of  the  21st 
Annual  Conference  on  Manual  Control  (NASA  CP- 2428,  pp.  3.1-3.17). 

Wickens,  C.D.  (1974,  August).  The  effect  of  time  sharing  on  the  performance 
of  information  processing  tasks:  A  feedback  control  analysis  (AD  A012 
023, Technical  Report  No.  51).  Ann  Arbor.  Michigan:  The  University  of 
Michigan,  Human  Performance  Center. 

wickens,  C.D.  (1976).  The  effects  of  divided  attention  on  information 

processing  in  manual  tracking.  Journal  of  Experimental  Psychology.  2, 
1-13. 


wickens,  C.D.  (1979).  Measures  of  workload,  stress  and  secondary  tasks.  Tn 
N.  Moray  (led.)  Mental  workload:  Us  theory  and  measurement.  New  York: 
Plenum  Press,  79  99. 

Wickens.  C.D.  (1979).  The  structure  of  attentional  resources.  In  K. 

Nickerson  (Ed.)  Attention  and  Performance  vtli.  Hillsdale,  New  Jersey: 
Lawrenece  Erlbaum  and  Associates.  (In  press). 

wickens,  C.  D.  (1981).  Processing  resources  in  attention,  dual  task  perfor¬ 
mance  .  and  work  1  '  ,d  assessment  (EPl.  YK  81  3/onr  tk  81  3).  Urbana 
Champaign:  University  of  Illinois,  Engineering  Psychology  Research 
Laboratory.  (DT1C  No.  AD  A102719) 

Wickens.  C.  D.  (1984).  The  multiple  resources  model  of  human  performance: 
Implications  for  display  design.  Aqard  Conference  Proceedings  No.  371: 
Human  Factors  Considerations  In  High  Performance  Air craft  (pp. 

17.1  17.6).  Neullly  sur  Seine.  France:  Advisory  Group  for  Aerospace 
Research  &  Development. 

wickens.  C..  Derrick,  W.,  Derringer,  l).,  6  Mlcallzzl,  J.  (1980).  The  structure 
of  processing  resources:  Xmpl Icat Ions  for  task  configuration  and 
workload.  Proceedings  of  the  Human  Factors  Aoclety  24th  Annual  Meeting, 
pp.  253-256. 

Wickens.  C.D.  6  Gopher.  D.  (1977).  Control  theory  measures  of  tracking  as 
indices  of  attention  allocation  strategies.  Human  Factors,  19,  349  365. 

Wickens,  C.  D.,  Harwood,  K..  Segal,  t...  Tkalcevic,  I.,  &  Sherman,  D.  (1988). 
TASKlt.lAN:  A  simulation  to  predict  the  valtdlty  of  multiple  resource 
models  of  aviation  workload.  Proceedings  of  the  Human  Factors  Society 
32nd  Annual  Meeting  (pp.  168  172).  Santa  Monica,  CA:  Human  Factors 
Society. 


12) 


Vlckens,  C.  D.,  Heffley,  E.  F.,  Kramer,  A.  F.,  &  Donchin.  E.  (1980).  The 
event-related  brain  potential  as  an  Index  of  attention  allocation  In 
complex  displays.  Proceedings  of  the  Human  Factors  Society  24th  Annual 
Meeting  (pp.  297-301).  bos  Angeles,  CA:  The  Human  Factors  Society. 

Vlckens,  C.  D.,  Hyman,  F.,  Dellinger,  J.,  Taylor,  H.,  &  Meador,  M.  (1986). 

The  Sternberg  memory  search  task  as  an  Index  of  pilot  workload. 

Ergonomics ,  29(11),  1371-1383. 

Vlckens,  C.  D.,  Isreal,  J.  B..  &  Donchin,  B.  (1977).  The  event  related 
cortical  potentials  as  an  Index  of  task  workload.  Proceedings  of  the 
Human  Factors  Society  21st  Annual  Meeting  (pp.  282-286).  Santa  Monica, 

CA:  Human  Factors  Society. 

Vlckens,  C.D.,  Isreal,  J.,  McCarthy.  G..  Gopher,  D.,  &  Donchin,  E.  (1976. 

May).  The  use  of  event- related  potentials  In  teh  enhancement  of  system 
performance  (NASA  TM  X-73,  170).  Proceedings  of  the  12th  Annual 
MASA-Unlverslty  Conference  on  Manual  Control.  University  of  Illinois. 

Vlckens,  C.D.,  6  Kessel,  C.  (1977,  June).  The  effects  of  participatory  mode 
and  task  workload  on  the  detection  of  dynamic  system  failures.  Proceedings 
of  the  13th  Annual  NASA-Unlverslty  Conference  on  Manual  Control , 
Massachusetts  Institute  of  Technology,  126- 135. 

Vlckens,  C.D.,  &  Kessel,  C.  (1979).  The  effects  of  participatory  mode  and 
track  workload  on  the  detection  of  dynamic  system  failures.  IEEE 
Transactions  on  Systems.  Man,  and  Cybernetics,  SMC  9,  24  34. 

Vlckens,  C.  D. ,  6  Kramer,  A.  (1985).  Engineering  psychology.  Annual  Review 
of  Psychology.  36.  307  348. 

Vlckens,  C.  D. ,  Mountford.  S.  J.,  6  Schreiner,  V.  (1981).  Multiple  resources . 
task- hemlspher Ic  Integrity,  and  individual  differences  In  time  sharing. 
Human  Factors,  23.  211  229. 

Vlckens,  C.D.,  Pierce,  B.  (1977.  February).  At  tent  Iona 1  resource  aHocat.lpn 
In  a  variable  difficulty  dual  task  paradigm  (Tech.  Rep.  afcxir  78  l/KPi. 
78-1).  Urbana  Champaign,  Illinois:  Engineering  Psychology  Laboratory , 
University  of  Illinois. 

Vlckens,  C.  D. ,  Sandry,  U.  L.,  6  Vldulich,  M.  A.  (1983).  Compatabl 1 Ity  and 
resource  competition  between  modalities  of  Input,  central  processing,  and 
outpet.  Human  Factors.  25,  227-248. 

Vlckens,  C.D.,  6  Tsartg,  P.  (1979,  June).  Attention  allocation  In  dynamic 
environments  (Tech.  Rep.  EPL  79  3/APOSR  79  3).  University  of  Illinois 
(Urbana  Champaign)  Engineering  Psychology  Research  Laboratory. 

Vlckens,  C.D.,  Tseng,  P.S.,  6  Bonel,  R . A .  (1979).  The  allocation  of 

attentlonal  resources  In  a  dynamic  environment.  Proceedings  of  the  23rd 
Annual  Meeting  of  the  Human  Factors  Society.  Boston,  Massachusetts, 

October  29  November  l,  527  531. 


122 


Vickens,  c.  D.,  Vldullch,  M.  A.,  &  Sandry-Garza,  D.  (1983).  Principles  of 
S-C-R  compatabillty  with  spatial  and  verbal  tasks.  Proceedings  o£  the 
Second  Symposium  on  Aviation  Psychology,  pp.  299-306. 

Vickens,  C.  D.»  &  Yeh,  Y.  Y.  (1983).  The  dlsassociation  between  subjective 
workload  and  performance:  A  nulitple  resource  approach.  Proceedings  of 
the  Human  Factors  Society  27th  Annual  Meeting.  1.  244-248. 

Vickens,  C.  D. ,  &  Yeh,  Y.  Y.  (1986).  A  multiple  resources  model  of  workload 
prediction  and  assessment.  Proceedings  of  the  I EKE  international 
Conference  on  Systems,  Wan,  and  Cybernetics.  2,  1044-1048. 

Wiener,  B.L.  (1977).  Controlled  flight  into  terrain  accidents:  system 
Induced  errors.  Human  Factors.  19.  171-181. 

Wiener,  E.  L..  Curry,  R.  E. .  6  Faustina,  H.  L.  (1984).  vigilance  and  task 
load:  In  search  of  the  inverted  U.  Human  Factors.  26.  215-222. 

Vierwllle,  W.W.  (1979).  Physiological  measures  of  aircrew  mental  workload. 
Human  Pactors,  21,  575-593. 

Vierwllle.  V.  V.  (1982).  Determination  of  sensitive  measures  of  pilot  workload 
as  a  function  of  the  type  of  piloting  task.  In  M.  L.  Frazier  and  R.  B. 
Cromble  (Eds.).  Proceedings  of  the  Workshop  on  Plight  Testing  to  Identify 
Pilot  Workload  and  Pilot  Dynamics  (AFFIX:  TR  82  5,  pp.  471  490).  Edwards 
Air  Force  Base,  CA:  Air  Force  Flight  Test  Center.  (DTIC  AD  A129333) 

Vierwllle,  w.  w.  (1983).  Comparative  evaluation  of  workload  estimation 

techniques  in  piloting  tasks  (NASA  CR  166496).  Washington,  DC:  National 
Aeronautics  and  Space  Administration. 

Vierwllle,  V.  V.,  6  Casali,  J.  G.  (1983).  A  validated  rating  scale  for  global 
mental  -workload  measurement  applications.  Proceedings  of  the  Human 
Factors  Society  27th  Annual  Meeting,  1,  129  133. 

vierwllle,  V.  V..  6  Connor.  S.  A.  (1983).  Evaluation  of  20  workload  measures 
using  a  psychomotor  task  in  a  moving  base  aircraft  simulator.  Human 
Factors.  25,  l  16. 

vierwllle,  V.W. ,  &  Gutmann,  J.C.  (1978).  Comparison  of  primary  and  secondary 
task  measures  as  a  function  of  simulated  vehicle  dynamics  and  driving 
conditions.  Human  Factors,  20,  233-244. 

Vierwllle,  V.V.,  Gutmann,  J.C.,  Hicks,  T.G.,  &  rtuto,  V.H.  (1977).  '.Secondary 
task  measurement  of  workload  as  a  function  of  simulated  vehicle  dynamics 
and  driving  conditions.  Human  Factors,  IJJ,  557-565. 

Vierwllle,  V.  V.,  Rahlml,  M. ,  6  Casali,  J.  G.  (1985).  Evaluation  of  16 
measures  of  mental  workload  using  a  simulated  flight  task  emphasizing 
medlational  activity.  Human  Factors.  27,  489  502. 


123 


Vierwille,  V.  V.,  Skipper,  3.  H.,  &  Riegar,  C.  A.  (1984).  Decision  tree 
rating  scales  Cor  workload  estimation:  Theme  and  variations.  Twentieth 
Annual  Conference  on  Manual  Control  Volume  I  (Rep.  Ho.  NASA  CP-2341,  pp. 
773-84).  Moffett  Pield,  CA:  National  Aeronautics  and  Space  Administration 

Vierwille,  V.  V.,  &  Villiges,  R.  C.  (1978).  Survey  and  analysis  of  operator 
workload  assessment  techniques  (NATC-TS-SY-78-101) .  Patuxent  River,  MD: 
Naval  Air  Test  Center.  (DTI C  No.  AD  A059S01) 

Vierwille,  V.  V.,  &  Villiges,  B.  H.  (1980).  An  annotated  bibliography  on 

operator  mental  workload  assessment  (NATC-SY-27R-80) .  Patuxent  River,  MD 
Naval  Air  Test  Center. 

Vllllams,  L.  3.  (1982).  Cognitive  load  and  the  functional  field  of  view. 
Human  Factors.  24(6).  683-692. 

Vllllams,  L.  J.  (1985).  Tunnel  vision  Induced  by  a  foveal  load  manipulation. 
Human  Factors,  22.  221-227. 

Vllson,  C.  F.  (1985).  A  neuropsychological  test  battery  for  workload  assess 
ment.  Proceedings  of  the  Human  Factors  Society  29th  Annual  Meeting.  I, 
224  225. 

Vllson,  G.  F. ,  O'Donnell,  R.  D.,  &  Vllson,  L.  (1982).  Neurophysiological 

measures  of  A- 10  workload  during  simulated  low  altitude  missions  (Rep.  No 
APAMRL  TR  83  0003,  pp.  1  30).  Wright  Patterson  Air  Force  Hase,  OH:  Air 
Force  Aerospace  Medical  Research  Laboratory. 

Woodward,  P.  P.  (1982).  Summary  report  and  abstracts:  u.S.  Navy  neuro 
physiology  research  conference.  New  Orleans,  UV:  office  of  Naval 
Research 

Wortmart,  0.  B.,  Seifert,  U.  J.,  &  Duket ,  S.  D.  (1975).  SAINT  simulation  of 
a  remotely  piloted  vehlclc/drone  control  facility  (AMKl.  TR  75  119). 

Wright  Patterson  Atr  Force  Hase,  OH:  Aeromedlcal  Research  Laboratory . 
(OTIC  No.  AD  A0299446) 

Wright.  P. ,  &  Kahnemari,  0.  (1971).  Kvldence  for  alternative  strategies  of 
sentence  retention.  Quarterly  Journal  of  Experimental  Psychology,  23. 

197  213. 

Yeh,  Y.  Y.,  &  W tokens,  C.  D.  (1984).  Why  do  performance  and  subjective 

workload  measures  disassociate?  Proceedings  of  the  Human  Factors  Society 
28th  Annual  Meeting,  l,  504  508. 

Yeh,  Y.  Y.,  6  Wlckens,  C.  0.  (1985).  An  Investigation  of  the  dlsassoclat Ion 
between  subject lve  measures  of  mental  workload  and  per f ormance  ( RPt.  TR 
84- l/NASA  TR  84  l).  Urbana  Champaign:  University  of  Illinois,  Kngi nee ring 
Psychology  Research  Laboratory. 

Yeh,  Y.,  6  Wlckens,  C.  D.  (1988).  Dissociation  of  performance  and  subjective 
measures  of  workload.  Human  Factors,  30,  111  120. 


124 


^ i  6  Wlckens,  C.  D.  (1988).  Dissociations  of  performance  and 
subjective  Measures  of  workload.  Human  Factors.  30(1),  111-120. 

Yeh,  Y.  Y . ,  wlckens,  C.  D.,  &  Hart  S.  C.  (1965).  The  effect  of  varying  task 
difficulty  on  subjective  workload.  Proceedings  of  the  Human  Pactors 
Society  29th  Annual  Meeting.  2,  765-769. 

Young,  c.  (1988,  April  24).  Blinking  may  mean  that  you've  just  stored  some 
Information.  Orlando,  FL:  Orlando  Sentinel,  p.  0-7. 

Young,  L.  R.,  &  Sheena,  D.  (1975).  Survey  of  eye  movement  recording  methods 
Behavior  Research  Methods  &  Instrumentation.  7(5),  397-429. 

Zeevi,  Y.  Y.,  Wetzel,  P.  A.,  6  Young,  I.  R.  (1983,  November).  Temporal  aspei 
of  eye  movement  when  viewing  multiple  targets  (APHRL  Tech.  Paper  83-6). 
Williams  Air  Porce  Base.  AL:  U.S.  Air  Force  Operations  Training  Division 


APPENDIX  B 

LIST  OP  PROFESSIONAL  PERSONNEL  ASSOCIATED  WITH  THE  RESEARCH  EFFORT 

(In  alphabetical  order) 


BRUNO  BREITMEYER 

Ph.D.  Psychology,  Stanford  University,  Palo  Alto,  CA,  1971 
B.A.  Mathematics,  University  of  Illinois,  Urbane,  IL.  1968 


JENNIFER  E,  FOWLKES 

Ph.D.  Experimental  Psychology,  University  of  Georgia,  Athens,  GA 

Expected  May  1988 

M.S .  By-Passed,  University  of  Georgia,  1985 

B.A.  Psychology,  Appalachian  State  University,  Boone,  NC 

MARSHALL  B.  JONES 

Ph.D.  Psychology,  University  of  California  at  Los  Angeles,  1953 
B.A.  Philosophy,  Yale  University,  1949 

ROBERT  S.  KENNEDY 

Ph.D.  Experimental  Psychology,  University  of  Rochester,  Rochester,  Now 

York,  1972. 

M.A.  Experimental  Psychology,  Pordham  University,  New  York,  Now  York, 

1959. 

B.A.  English  &  Philosophy.  Iona  College,  New  Rochelle,  New  York,  195/. 

JAMES  E.  MAY 

Ph.D.  Psychology,  University  of  Houston,  Texas,  1969 

M.S.  Psychology,  University  of  Southern  Mississippi,  1966 

B.A.  Psychology,  Louisiana  State  University,  1965 

KEVIN  SCHNIT7.1US 

B.5.  Computer  Science,  University  of  Central  Florida. 

Expected  May  1988. 


MARTIN  G.  SMITH 

B.A.  Psychology,  University  of  Central  Florida,  1975 


126 


APPENDIX  C 


MANUSCRIPTS  PLANNED  FOR  LATER  SUBMISSIOM 


Kennedy.  R.  S.,  May,  J.  G,  Jones,  M.  B..  &  Fowlkes,  J.  B.  (1983).  Review 
of  eye  movement  Indicants  of  mental  workload.  Manuscript  to  be 
prepared  and  submitted  to  Human  Factors. 

Kennedy,  R.  S.,  May,  J.  G.,  Smith.  M.  G.,  Schnitzius,  K..  &  Fowlkes,  J.  E. 
(1988).  Saccade  length  as  an  index  of  mental  workload.  Manuscript  to 
be  prepared  and  submitted  to  Human  Factors. 


